Adaptation for entropy coding of blocks of image data

ABSTRACT

Systems and methods are disclosed for entropy coding of blocks of image data. For example, methods may include partitioning a block of video data into a plurality of groups of elements; decoding, using an entropy decoder, data from an encoded bitstream to obtain, using a first scan order, elements of a first group from the plurality of groups of elements, wherein the first group includes elements forming a triangle in a corner of the block, and wherein the triangle includes elements of a first row and elements of a first column of the block; determining, based on the elements of the first group, a second scan order for a second group from the plurality of groups of elements; and decoding, using the entropy decoder, data from the encoded bitstream to obtain, using the second scan order, elements of the second group from the plurality of groups of elements.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of U.S. patent Ser. No. 15/668,745filed on Aug. 4, 2017. The entire contents of that application arehereby incorporated by reference in the specification of thisapplication.

BACKGROUND

Digital video streams may represent video using a sequence of frames orstill images. Digital video can be used for various applicationsincluding, for example, video conferencing, high definition videoentertainment, video advertisements, or sharing of user-generatedvideos. A digital video stream can contain a large amount of data andconsume a significant amount of computing or communication resources ofa computing device for processing, transmission or storage of the videodata. Various approaches have been proposed to reduce the amount of datain video streams, including compression and other encoding techniques.

Encoding based on spatial similarities may be performed by breaking aframe or image into blocks that are predicted based on other blockswithin the same frame or image. Differences (i.e., residual errors)between blocks and prediction blocks are compressed and encoded in abitstream. A decoder uses the differences and reference frames toreconstruct the frames or images.

SUMMARY

This application relates to encoding and decoding a current block ofvideo data. Disclosed herein are aspects of systems, methods, andapparatuses for encoding and decoding the current block using adaptationfor entropy coding.

One aspect of the disclosed implementations is a system for decodingvideo. The system includes a memory and a processor. The memory storesinstructions executable by the processor to cause the system to:partition a block of video data into a plurality of groups of elements;decode, using an entropy decoder, data from an encoded bitstream toobtain elements of a first group from the plurality of groups ofelements; determine a category based on the elements of the first group;based on the category, select a context for an element from a secondgroup from the plurality of groups of elements; and decode, using theentropy decoder using the context, data from the encoded bitstream toobtain the element of the second group from the plurality of groups ofelements.

Another aspect is a method for decoding video. The method includespartitioning a block of video data into a plurality of groups ofelements; decoding, using an entropy decoder, data from an encodedbitstream to obtain elements of a first group from the plurality ofgroups of elements; determining a category based on the elements of thefirst group; based on the category, selecting a context for an elementfrom a second group from the plurality of groups of elements; anddecoding, using the entropy decoder using the context, data from theencoded bitstream to obtain the element of the second group from theplurality of groups of elements.

Another aspect is a system for encoding video. The system includes amemory and a processor. The memory stores instructions executable by theprocessor to cause the system to: partition a block of video data into aplurality of groups of elements; encode, using an entropy encoder,elements of a first group from the plurality of groups of elements;determine a category based on the elements of the first group; based onthe category, select a context for an element from a second group fromthe plurality of groups of elements; and encode, using the entropyencoder using the context, the element of the second group from theplurality of groups of elements.

Another aspect of the disclosed implementations is a system for decodingvideo. The system includes a memory and a processor. The memory storesinstructions executable by the processor to cause the system to:partition a block of video data into a plurality of groups of elements;decode, using an entropy decoder, data from an encoded bitstream toobtain, using a first scan order, elements of a first group from theplurality of groups of elements, wherein the first group includeselements forming a triangle in a corner of the block, and wherein thetriangle includes elements of a first row of the block and elements of afirst column of the block; determine, based on the elements of the firstgroup, a second scan order for a second group from the plurality ofgroups of elements; and decode, using the entropy decoder, data from theencoded bitstream to obtain, using the second scan order, elements ofthe second group from the plurality of groups of elements.

Another aspect is a method for decoding video. The method includespartitioning a block of video data into a plurality of groups ofelements; decoding, using an entropy decoder, data from an encodedbitstream to obtain, using a first scan order, elements of a first groupfrom the plurality of groups of elements, wherein the first groupincludes elements forming a triangle in a corner of the block, andwherein the triangle includes elements of a first row of the block andelements of a first column of the block; determining, based on theelements of the first group, a second scan order for a second group fromthe plurality of groups of elements; and decoding, using the entropydecoder, data from the encoded bitstream to obtain, using the secondscan order, elements of the second group from the plurality of groups ofelements.

Another aspect is a system for encoding video. The system includes amemory and a processor. The memory stores instructions executable by theprocessor to cause the system to: partition a block of video data into aplurality of groups of elements; encode, using an entropy encoder usinga first scan order, elements of a first group from the plurality ofgroups of elements, wherein the first group includes elements forming atriangle in a corner of the block, and wherein the triangle includeselements of a first row of the block and elements of a first column ofthe block; determine, based on the elements of the first group, a secondscan order for a second group from the plurality of groups of elements;and encode, using the entropy encoder using the second scan order,elements of the second group from the plurality of groups of elements.

These and other aspects of the present disclosure are disclosed in thefollowing detailed description of the embodiments, the appended claimsand the accompanying figures.

BRIEF DESCRIPTION OF THE DRAWINGS

The description herein makes reference to the accompanying drawingswherein like reference numerals refer to like parts throughout theseveral views.

FIG. 1 is a schematic of a video encoding and decoding system.

FIG. 2 is a block diagram of an example of a computing device that canimplement a transmitting station or a receiving station.

FIG. 3 is a diagram of a video stream to be encoded and subsequentlydecoded.

FIG. 4 is a block diagram of an encoder according to implementations ofthis disclosure.

FIG. 5 is a block diagram of a decoder according to implementations ofthis disclosure.

FIG. 6 is a diagram illustrating quantized transform coefficients inaccordance with implementations of this disclosure.

FIG. 7A is a block diagram of an encoder that separately encodesquantized coefficients and an intra-prediction mode.

FIG. 7B is a block diagram of a decoder that separately decodesquantized coefficients and an intra-prediction mode.

FIG. 8A is a block diagram of an encoder that uses the intra-predictionmode to encode the quantized coefficients.

FIG. 8B is a block diagram of a decoder that uses the intra-predictionmode to decode the quantized coefficients.

FIG. 9 is a flowchart diagram of a process for coding a current blockusing an intra-prediction mode according to an implementation of thisdisclosure.

FIG. 10 is a block diagram of an encoder according to implementations ofthis disclosure.

FIG. 11 is a flowchart diagram of a process for decoding a current blockusing an intra-prediction mode according to an implementation of thisdisclosure.

FIG. 12 is a block diagram of a decoder according to implementations ofthis disclosure.

FIG. 13 is a flowchart diagram of a process for reconstructing a currentblock using an intra-prediction mode according to an implementation ofthis disclosure.

FIG. 14A is a diagram of an intra-prediction mode having a 90 degreeprediction angle according to implementations of this disclosure.

FIG. 14B is a diagram of an intra-prediction mode having a 135 degreeprediction angle according to implementations of this disclosure.

FIG. 15A is a diagram of an example of a set of scan orders for a blockthat are adapted based on data of a first group of elements of theblock.

FIG. 15B is a diagram of an example of a set of scan orders for a blockthat are adapted based on a non-zero map for a first group of elementsof the block.

FIG. 16 is a flowchart of an example of a process for adapting scanorder to encode a block of video data.

FIG. 17 is a flowchart of an example of a process for adapting scanorder to decode a block of video data.

FIG. 18A is a flowchart of an example of a process for determining ascan order for a next group of elements of a block of video data.

FIG. 18B is a flowchart of an example of a process for determining ascan order for a next group of elements of a block of video data.

FIG. 19 is a flowchart of an example of a process for adapting scanorder to encode a block of video data and encoding an intra-predictionmode for the block using a context selected based on data in the block.

FIG. 20 is a flowchart of an example of a process for adapting scanorder to decode a block of video data and decoding an intra-predictionmode for the block using a context selected based on data in the block.

FIG. 21A is a diagram of an example of a set of scan orders for a blockthat are adapted based on data of a first group of elements of theblock.

FIG. 21B is a diagram of an example of a set of scan orders for a blockthat are adapted based on magnitudes for a first group of elements ofthe block.

FIG. 22A is a diagram of an example of a scan order for a first group ofelements of a block of image data.

FIG. 22B is a diagram of an example of a scan order for a first group ofelements of a block of image data.

FIG. 23 is a flowchart of an example of a process for adapting contextto encode a block of video data.

FIG. 24 is a flowchart of an example of a process for adapting contextto decode a block of video data.

FIG. 25A is a flowchart of an example of a process for determining acategory for a block based on a subset of elements of the block of imagedata.

FIG. 25B is a flowchart of an example of a process for determining acategory for a block based on a subset of elements of the block of imagedata.

DETAILED DESCRIPTION

Compression schemes related to coding video streams may include breakingimages into blocks and generating a digital video output bitstream(i.e., an encoded bitstream) using one or more techniques to reduce thedata rate of the output bitstream. A received bitstream can be decodedto re-construct the blocks and the source images from the compressedinformation. Techniques used to encode and decode video streams caninclude entropy coding of components of a video signal (e.g., aprediction residual for a block from a frame of video).

A hybrid video coding framework may make use of prediction, transform,quantization, and/or entropy coding to compress a block of video data.Depending upon a pattern occurring in a block of quantized transformcoefficients after prediction, transform, and quantization, compressionperformance of entropy coding may be improved by adaptively selecting ascan order instead of using a fixed scan order. For example, if asignificant number of zero valued coefficients occur at the end of thescan order for the block, then the ending run of zeros can be veryefficiently coded (e.g., using an entropy encoder or an entropy decoder)explicitly or implicitly (e.g., by an end of block indication).

A block may be partitioned for entropy coding into a plurality of groupsof elements (e.g., quantized transform coefficients of a residualblock), and information in the a first group of elements that are codedusing a default scan order, which is available at both the encoder andcompatible decoder, may be used to determine a scan order for a nextgroup. For example, based on a distribution of non-zero valued elementsin prior coded groups of elements, a scan order for the last group(s) ofelements of the block may be selected to increase the probability ofzero valued elements occurring at the end of the resulting scan orderfor the block. In some implementations, scan order adaptation is basedonly on information available in the current block of elements (e.g.,quantized transform coefficients of a residual block). Such a scheme mayoffer the advantage of avoiding dependency of the entropy coding of theblock on other parameters, such as an intra-prediction mode for theblock or coefficient statistics for other blocks of the video that maybe used by a constrained adaptive scan order scheme.

Information in the first group of elements may also be leveraged toimprove coding efficiency of an entropy coding scheme by adapting one ormore contexts that are used to code subsequent groups of elements in theblock (e.g., a second group of elements including all remainingelements). For example, a category may be determined based on elementsof the first group and a context used for coding an element of a secondgroup of elements of the block may be selected based in part on thecategory. In some implementations, a scan order for the second group ofelements may also be determined based on the category.

The first group of elements, which are used to adapt a context and/or ascan order used for coding a second group of elements of the block, maybe designed to reduce the size of the first group while still providingenough information to robustly inform adaptation. By reducing the sizeof the first group improved adapted coding parameters (e.g., contexts orscan orders) may be applied to a larger percentage of the elements of ablock to improve overall coding efficiency. Coding efficiency can alsobe improved by designing the first group to include the elements of theblock most likely to be non-zero (e.g., by using an upper-lefttriangular shape for the first group), to avoid constraining theselikely non-zero coefficients to be coded after the first group. In someimplementations, the shape and size of a first group of elements may beselected based on a size of the block.

By adaptively determining the coding context(s) and/or the ending scanorder for a block based on information in a partitioned group ofelements of the block that start the scan order, a number of advantagesmay be achieved over other coding schemes. For example, the advantagesmay include (1) increasing the coding efficiency of the an entropyencoder/decoder by using a scan order and/or a context that is adaptedto the distribution of non-zero coefficients in the current block; (2)allowing the processing of blocks of a frame in different orders byavoiding a parsing dependency on information outside of the currentblock; and/or (3) enabling the improvement of intra-prediction modecoding efficiency by enabling intra-prediction modes to be decoded afterthe elements of a residual block and leveraging correlation between theelements of the block and the intra-prediction mode used to generate theblock.

The scan order for a block based on a residual block resulting frominter-prediction may be adapted based on information in a partitionedgroup of elements of the block that start the scan order. For example,inter-prediction may use a motion vector that represents the spatialdisplacement of a previously coded block relative to the current block.The motion vector can be identified using a method of motion estimation,such as a motion search. In the motion search, a portion of a referenceframe can be translated to a succession of locations to form aprediction block that can be subtracted from a portion of a currentframe to form a series of residuals. The horizontal and/or verticaltranslations corresponding to the location having, e.g., the smallest,residual can be selected as the motion vector. The motion vector can beencoded in the encoded bitstream along with an indication of thereference frame. A resulting inter-prediction residual may exhibitspatial patterns that can be recognized and exploited to improve entropycoding efficiency for the residual by adapting the scan order for ablock based on the residual.

Encoding a video stream, or a portion thereof, such as a frame or ablock, can include using spatial similarities in the video stream toimprove coding efficiency. For example, a current block of a videostream may be encoded based on identifying a difference (residual)between the previously coded pixel values, or between a combination ofpreviously coded pixel values, and those in the current block.

Encoding using spatial similarities can be known as intra prediction.Intra prediction attempts to predict the pixel values of a current blockof a frame of a video stream using pixels peripheral to the currentblock; that is, using pixels that are in the same frame as the currentblock but that are outside of the current block. Intra prediction can beperformed along a direction of prediction, referred to herein asprediction angle, where directions can correspond to respectiveintra-prediction modes. An intra-prediction mode uses pixels peripheralto the current block being predicted. Pixels peripheral to the currentblock are pixels outside the current block.

Many different intra-prediction modes can be supported. Someintra-prediction modes may be referred to as directionalintra-prediction modes, which may have corresponding prediction angles.Directional intra-prediction modes can include, for example, horizontalintra-prediction modes, vertical intra-prediction modes, and diagonalintra-prediction modes. A horizontal intra-prediction mode correspondsto an intra-prediction having a prediction angle that is generallyhorizontal. A vertical intra-prediction mode corresponds to anintra-prediction having a prediction angle that is generally vertical. Adiagonal intra-prediction mode corresponds to a directionalintra-prediction having a prediction angle that is neither generallyhorizontal nor generally vertical. The prediction angle of a directionalintra-prediction mode can be a prediction angle between 0 and 360degrees. In some implementations, the prediction angle can be aprediction angle between 0 and 270 degrees. Available prediction anglescan also be a subset of all possible prediction angles. For example, acodec can have available prediction modes corresponding to 50-60discrete prediction angles of the 0 to 360 prediction angles. Nondirectional intra-prediction modes can also be supported, including, forexample, a planar intra-prediction mode and a DC intra-prediction mode.

Directional intra-prediction modes can be used to propagate pixel valuesfrom previously coded blocks along an angular line to predict a block.For example, pixel values being propagated can include peripheral pixelsabove and/or to the left of the block in the same frame (e.g., whenraster scan order is used in encoding). FIGS. 14A and 14B illustrate twoexample of intra prediction.

FIG. 14A is a diagram of an intra-prediction mode 1401 having a 90degree prediction angle according to implementations of this disclosure.FIG. 14A illustrates generating a prediction block for a 4×4 block to bepredicted (also called a current block) using a verticalintra-prediction mode. The intra-prediction mode of FIG. 14A propagatesperipheral pixels A through D down the columns of the prediction blocksuch that each pixel in a column has its value set equal to that of theadjacent peripheral pixel A through D in the direction of the arrows.

FIG. 14B is a diagram of an intra-prediction mode 1402 having a 135degree prediction angle according to implementations of this disclosure.FIG. 14B illustrates generating a prediction block for a 4×4 currentblock using a diagonal intra-prediction mode. The intra-prediction modeof FIG. 14B propagates peripheral pixel values along a 135 degree line(i.e., lines 1406) to the right and down to form the prediction block.The peripheral pixel values can include, for example, some of peripheralpixels 1408 (i.e., pixels A through R) from blocks adjacent to the 4×4current block of a frame 1410, to form the prediction block 1403 for thecurrent block. Although the 135 degree intra-prediction mode in FIG. 14Bis illustrated using the pixel values of the peripheral pixels 1408 togenerate the prediction block 1403 for example, a linear combination(e.g., weighted average) of some (e.g., two, three, or more) of theperipheral pixels can be used to predict pixel values of the predictionblock along lines extending through the block. For example, the pixelvalue 1404 to be propagated along line 1406 can be formed from aweighted average of pixel values K, L, and M.

As further described below, a residual block of residual errors canresult from the intra prediction of a block of a video stream. Theresidual block can be in the pixel domain. The residual block can betransformed into the frequency domain resulting in a transform block oftransform coefficients. The transform coefficients can be quantizedresulting into a quantized transform block of quantized transformcoefficients (also referred to herein as quantized coefficients). Aquantized transform block of quantized transform coefficients is alsoreferred to herein as a block of quantized transform coefficients. Thequantized coefficients can be entropy encoded and added to an encodedbitstream. The intra-prediction mode can also be entropy encoded andadded to the encoded bitstream. A decoder can receive the encodedbitstream, entropy decode the quantized transform coefficients and/orthe intra-prediction mode to reconstruct the original video frame.

The number of bits used to encode the intra-prediction mode can dependon the number of available intra-prediction modes. In a video codingsystem where N intra-prediction modes are available, log₂N bits may berequired to indicate the prediction mode. For example, in a system wherenine (9) or ten (10) intra-prediction modes are available for a 4×4luminance block, four (4) bits may be required to indicate anintra-prediction mode. In a system where 35 intra-prediction modes areavailable for a 4×4 luminance block, six (6) bits may be required toindicate an intra-prediction mode. Coding systems that use moreintra-prediction modes require more bits to encode an intra-predictionmode.

As the number of available intra-prediction modes increases, the cost(in bits) of encoding an intra-prediction mode increases. In somesituations, the number of bits required to encode an intra-predictionmode can be greater than the number of bits required to encode the pixelvalues of the current block being encoded. For example, to encode a 4×4block (which contains 16 pixels) in a coding system that uses more than16 intra-prediction modes, the number of distinct prediction modes ishigher than the number of pixels to be predicted. This results in aproblem of over saturation.

Implementations of this disclosure can improve video compression usingimproved coding of intra-prediction modes. Implementations according tothis disclosure can use information in residual blocks to improve thecompression performance of intra-prediction modes. For example,information in the quantized transform block can be used by an entropyencoder to encode the intra-prediction mode thereby improvingcompression performance. By using information in the quantized transformblock, the bit rates resulting from encoding an intra-prediction modecan be reduced. Encoders and decoders according to implementations ofthis disclosure can improve the entropy coding without increasing thecomplexity of the encoding and decoding.

Details are described herein after first describing an environment inwhich the improved coding of intra-prediction modes disclosed herein maybe implemented.

FIG. 1 is a schematic of a video encoding and decoding system 100. Atransmitting station 102 can be, for example, a computer having aninternal configuration of hardware such as that described in FIG. 2.However, other suitable implementations of the transmitting station 102are possible. For example, the processing of the transmitting station102 can be distributed among multiple devices.

A network 104 can connect the transmitting station 102 and a receivingstation 106 for encoding and decoding of the video stream. Specifically,the video stream can be encoded in the transmitting station 102 and theencoded video stream can be decoded in the receiving station 106. Thenetwork 104 can be, for example, the Internet. The network 104 can alsobe a local area network (LAN), wide area network (WAN), virtual privatenetwork (VPN), cellular telephone network or any other means oftransferring the video stream from the transmitting station 102 to, inthis example, the receiving station 106.

The receiving station 106, in one example, can be a computer having aninternal configuration of hardware such as that described in FIG. 2.However, other suitable implementations of the receiving station 106 arepossible. For example, the processing of the receiving station 106 canbe distributed among multiple devices.

Other implementations of the video encoding and decoding system 100 arepossible. For example, an implementation can omit the network 104. Inanother implementation, a video stream can be encoded and then storedfor transmission at a later time to the receiving station 106 or anyother device having memory. In one implementation, the receiving station106 receives (e.g., via the network 104, a computer bus, and/or somecommunication pathway) the encoded video stream and stores the videostream for later decoding. In an example implementation, a real-timetransport protocol (RTP) is used for transmission of the encoded videoover the network 104. In another implementation, a transport protocolother than RTP may be used, e.g., a Hyper-Text Transfer Protocol(HTTP)-based video streaming protocol.

When used in a video conferencing system, for example, the transmittingstation 102 and/or the receiving station 106 may include the ability toboth encode and decode a video stream as described below. For example,the receiving station 106 could be a video conference participant whoreceives an encoded video bitstream from a video conference server(e.g., the transmitting station 102) to decode and view and furtherencodes and transmits its own video bitstream to the video conferenceserver for decoding and viewing by other participants.

FIG. 2 is a block diagram of an example of a computing device 200 thatcan implement a transmitting station or a receiving station. Forexample, the computing device 200 can implement one or both of thetransmitting station 102 and the receiving station 106 of FIG. 1. Thecomputing device 200 can be in the form of a computing system includingmultiple computing devices, or in the form of a single computing device,for example, a mobile phone, a tablet computer, a laptop computer, anotebook computer, a desktop computer, and the like.

A CPU 202 in the computing device 200 can be a central processing unit.Alternatively, the CPU 202 can be any other type of device, or multipledevices, capable of manipulating or processing information now-existingor hereafter developed. Although the disclosed implementations can bepracticed with a single processor as shown, e.g., the CPU 202,advantages in speed and efficiency can be achieved using more than oneprocessor.

A memory 204 in the computing device 200 can be a read-only memory (ROM)device or a random access memory (RAM) device in an implementation. Anyother suitable type of storage device can be used as the memory 204. Thememory 204 can include code and data 206 that is accessed by the CPU 202using a bus 212. The memory 204 can further include an operating system208 and application programs 210, the application programs 210 includingat least one program that permits the CPU 202 to perform the methodsdescribed here. For example, the application programs 210 can includeapplications 1 through N, which further include a video codingapplication that performs the methods described here. The computingdevice 200 can also include a secondary storage 214, which can, forexample, be a memory card used with a computing device 200 that ismobile. Because the video communication sessions may contain asignificant amount of information, they can be stored in whole or inpart in the secondary storage 214 and loaded into the memory 204 asneeded for processing.

The computing device 200 can also include one or more output devices,such as a display 218. The display 218 may be, in one example, a touchsensitive display that combines a display with a touch sensitive elementthat is operable to sense touch inputs. The display 218 can be coupledto the CPU 202 via the bus 212. Other output devices that permit a userto program or otherwise use the computing device 200 can be provided inaddition to or as an alternative to the display 218. When the outputdevice is or includes a display, the display can be implemented invarious ways, including by a liquid crystal display (LCD), a cathode-raytube (CRT) display or light emitting diode (LED) display, such as anorganic LED (OLED) display.

The computing device 200 can also include or be in communication with animage-sensing device 220, for example a camera, or any otherimage-sensing device 220 now existing or hereafter developed that cansense an image such as the image of a user operating the computingdevice 200. The image-sensing device 220 can be positioned such that itis directed toward the user operating the computing device 200. In anexample, the position and optical axis of the image-sensing device 220can be configured such that the field of vision includes an area that isdirectly adjacent to the display 218 and from which the display 218 isvisible.

The computing device 200 can also include or be in communication with asound-sensing device 222, for example a microphone, or any othersound-sensing device now existing or hereafter developed that can sensesounds near the computing device 200. The sound-sensing device 222 canbe positioned such that it is directed toward the user operating thecomputing device 200 and can be configured to receive sounds, forexample, speech or other utterances, made by the user while the useroperates the computing device 200.

Although FIG. 2 depicts the CPU 202 and the memory 204 of the computingdevice 200 as being integrated into a single unit, other configurationscan be utilized. The operations of the CPU 202 can be distributed acrossmultiple machines (each machine having one or more processors) that canbe coupled directly or across a local area or other network. The memory204 can be distributed across multiple machines such as a network-basedmemory or memory in multiple machines performing the operations of thecomputing device 200. Although depicted here as a single bus, the bus212 of the computing device 200 can be composed of multiple buses.Further, the secondary storage 214 can be directly coupled to the othercomponents of the computing device 200 or can be accessed via a networkand can comprise a single integrated unit such as a memory card ormultiple units such as multiple memory cards. The computing device 200can thus be implemented in a wide variety of configurations.

FIG. 3 is a diagram of an example of a video stream 300 to be encodedand subsequently decoded. The video stream 300 includes a video sequence302. At the next level, the video sequence 302 includes a number ofadjacent frames 304. In some cases, a frame may be referred to as apicture. While three frames are depicted as the adjacent frames 304, thevideo sequence 302 can include any number of adjacent frames 304. Theadjacent frames 304 can then be further subdivided into individualframes, e.g., a frame 306. At the next level, the frame 306 can bedivided into a series of segments 308 or planes. The segments 308 can besubsets of frames that permit parallel processing, for example. Thesegments 308 can also be subsets of frames that can separate the videodata into separate colors. For example, the frame 306 of color videodata can include a luminance plane and two chrominance planes. Thesegments 308 may be sampled at different resolutions.

Whether or not the frame 306 is divided into the segments 308, the frame306 may be further subdivided into blocks 310, which can contain datacorresponding to, for example, 16×16 pixels in the frame 306. The blocks310 can also be arranged to include data from one or more segments 308of pixel data. The blocks 310 can also be of any other suitable sizesuch as 4×4 pixels, 8×8 pixels, 16×8 pixels, 8×16 pixels, 16×16 pixels,4×32 pixels, 8×32 pixels, 16×32 pixels, 32×4 pixels, 32×8 pixels, 32×16pixels, 32×32 pixels, 64×64 pixels, or in general N×M pixels, where N, Mmay be an integer power of 2 like 2, 4, 8, 16, 32, 64, 128, 256, orlarger.

FIG. 4 is a block diagram of an encoder 400 according to implementationsof this disclosure. The encoder 400 can be implemented, as describedabove, in the transmitting station 102 such as by providing a computersoftware program stored in memory, for example, the memory 204. Thecomputer software program can include machine instructions that, whenexecuted by a processor such as the CPU 202, cause the transmittingstation 102 to encode video data in the manner described herein. Theencoder 400 can also be implemented as specialized hardware included in,for example, the transmitting station 102. The encoder 400 has thefollowing stages to perform the various functions in a forward path(shown by the solid connection lines) to produce an encoded orcompressed bitstream 420 using the video stream 300 as input: anintra/inter prediction stage 402, a transform stage 404, a quantizationstage 406, and an entropy encoding stage 408. The encoder 400 may alsoinclude a reconstruction path (shown by the dotted connection lines) toreconstruct a frame for encoding of future blocks. In FIG. 4, theencoder 400 has the following stages to perform the various functions inthe reconstruction path: a dequantization stage 410, an inversetransform stage 412, a reconstruction stage 414, and a loop filteringstage 416. Other structural variations of the encoder 400 can be used toencode the video stream 300.

When the video stream 300 is presented for encoding, the frame 306 canbe processed in units of blocks. At the intra/inter prediction stage402, a block can be encoded using intra-frame prediction (also calledintra-prediction) or inter-frame prediction (also calledinter-prediction), or a combination of both. In any case, a predictionblock can be formed. In the case of intra-prediction, all or a part of aprediction block may be formed from samples in the current frame thathave been previously encoded and reconstructed. In the case ofinter-prediction, all or part of a prediction block may be formed fromsamples in one or more previously constructed reference framesdetermined using motion vectors.

Next, still referring to FIG. 4, the prediction block can be subtractedfrom the current block at the intra/inter prediction stage 402 toproduce a residual block (also called a residual). The transform stage404 transforms the residual into transform coefficients in, for example,the frequency domain using block-based transforms. Such block-basedtransforms include, for example, the Discrete Cosine Transform (DCT) andthe Asymmetric Discrete Sine Transform (ADST). Other block-basedtransforms (e.g., identity transform, transpose, rotation, andKarhunen-Loève transform (KLT)) are possible. Further, combinations ofdifferent transforms may be applied to a single residual. In one exampleof application of a transform, the DCT transforms the residual blockinto the frequency domain where the transform coefficient values arebased on spatial frequency. The lowest frequency (DC) coefficient at thetop-left of the matrix and the highest frequency coefficient at thebottom-right of the matrix. It is worth noting that the size of aprediction block, and hence the resulting residual block, may bedifferent from the size of the transform block. For example, theprediction block may be split into smaller blocks to which separatetransforms are applied.

The quantization stage 406 converts the transform coefficients intodiscrete quantum values, which are referred to as quantized transformcoefficients, using a quantizer value or a quantization level. Forexample, the transform coefficients may be divided by the quantizervalue and truncated. The quantized transform coefficients are thenentropy encoded by the entropy encoding stage 408. Entropy coding may beperformed using any number of techniques, including token and binarytrees. The entropy-encoded coefficients, together with other informationused to decode the block, which may include for example the type ofprediction used, transform type, motion vectors and quantizer value, arethen output to the compressed bitstream 420. The information to decodethe block may be entropy coded into block, frame, slice and/or sectionheaders within the compressed bitstream 420. The compressed bitstream420 can also be referred to as an encoded video stream or encoded videobitstream, and the terms will be used interchangeably herein.

The reconstruction path in FIG. 4 (shown by the dotted connection lines)can be used to ensure that both the encoder 400 and a decoder 500(described below) use the same reference frames and blocks to decode thecompressed bitstream 420. The reconstruction path performs functionsthat are similar to functions that take place during the decodingprocess that are discussed in more detail below, including dequantizingthe quantized transform coefficients at the dequantization stage 410 andinverse transforming the dequantized transform coefficients at theinverse transform stage 412 to produce a derivative residual block (alsocalled a derivative residual). At the reconstruction stage 414, theprediction block that was predicted at the intra/inter prediction stage402 can be added to the derivative residual to create a reconstructedblock. The loop filtering stage 416 can be applied to the reconstructedblock to reduce distortion such as blocking artifacts.

Other variations of the encoder 400 can be used to encode the compressedbitstream 420. For example, a non-transform based encoder 400 canquantize the residual signal directly without the transform stage 404for certain blocks or frames. In another implementation, an encoder 400can have the quantization stage 406 and the dequantization stage 410combined into a single stage.

FIG. 5 is a block diagram of a decoder 500 according to implementationsof this disclosure. The decoder 500 can be implemented in the receivingstation 106, for example, by providing a computer software programstored in the memory 204. The computer software program can includemachine instructions that, when executed by a processor such as the CPU202, cause the receiving station 106 to decode video data in the mannerdescribed herein. The decoder 500 can also be implemented in hardwareincluded in, for example, the transmitting station 102 or the receivingstation 106. The decoder 500, similar to the reconstruction path of theencoder 400 discussed above, includes in one example the followingstages to perform various functions to produce an output video stream516 from the compressed bitstream 420: an entropy decoding stage 502, adequantization stage 504, an inverse transform stage 506, anintra/inter-prediction stage 508, a reconstruction stage 510, a loopfiltering stage 512 and a post-processing stage 514 (e.g., includingdeblocking filtering). Other structural variations of the decoder 500can be used to decode the compressed bitstream 420.

When the compressed bitstream 420 is presented for decoding, the dataelements within the compressed bitstream 420 can be decoded by theentropy decoding stage 502 to produce a set of quantized transformcoefficients. The dequantization stage 504 dequantizes the quantizedtransform coefficients (e.g., by multiplying the quantized transformcoefficients by the quantizer value), and the inverse transform stage506 inverse transforms the dequantized transform coefficients using theselected transform type to produce a derivative residual that can beidentical to that created by the inverse transform stage 412 in theencoder 400. Using header information decoded from the compressedbitstream 420, the decoder 500 can use the intra/inter-prediction stage508 to create the same prediction block as was created in the encoder400, e.g., at the intra/inter prediction stage 402. At thereconstruction stage 510, the prediction block can be added to thederivative residual to create a reconstructed block. The loop filteringstage 512 can be applied to the reconstructed block to reduce blockingartifacts. Other filtering can be applied to the reconstructed block. Inthis example, the deblocking filtering is applied by the post-processingstage 514 to the reconstructed block to reduce blocking distortion, andthe result is output as an output video stream 516. The output videostream 516 can also be referred to as a decoded video stream, and theterms will be used interchangeably herein.

Other variations of the decoder 500 can be used to decode the compressedbitstream 420. For example, the decoder 500 can produce the output videostream 516 without the post-processing stage 514. In someimplementations of the decoder 500, the post-processing stage 514 (e.g.,including deblocking filtering) is applied before the loop filteringstage 512. Additionally, or alternatively, the encoder 400 includes adeblocking filtering stage in addition to the loop filtering stage 416.

FIG. 6 is a diagram 600 illustrating quantized transform coefficients inaccordance with implementations of this disclosure. The diagram 600depicts a current block 620, a scan order 602, a quantized transformblock 604, a non-zero map 606, an end-of-block map 622, and a sign map626. The current block 620 is illustrated as a 4×4 block. However, anyblock size is possible. For example, the current block can have a size(i.e., dimensions) of 4×4, 8×8, 16×16, 32×32, or any other square orrectangular block size. The current block 620 can be a block of acurrent frame. In another example, the current frame may be partitionedinto segments (such as the segments 308 of FIG. 3), tiles, or the like,each including a collection of blocks, where the current block is ablock of the partition.

The quantized transform block 604 can be a block of size similar to thesize of the current block 620. The quantized transform block 604includes non-zero coefficients (e.g., a coefficient 608) and zerocoefficients (e.g., a coefficient 610). As described above, thequantized transform block 604 contains quantized transform coefficientsfor the residual block corresponding to the current block 620. Also asdescribed above, the quantized transform coefficients are entropy codedby an entropy coding phase, such as the entropy coding stage 408 of FIG.4.

Entropy coding a quantized transform coefficient can involve theselection of a context model (also referred to as probability contextmodel, probability model, and context) which provides estimates ofconditional probabilities for coding the binary symbols of a binarizedtransform coefficient. When entropy coding a quantized transformcoefficient, additional information may be used as the context forselecting a context model. For example, the magnitudes of the previouslycoded transform coefficients can be used, at least partially, fordetermining a probability model.

To encode a transform block, a video coding system may traverse thetransform block in a scan order and encode (e.g., entropy encode) thequantized transform coefficients as the quantized transform coefficientsare respectively traversed (i.e., visited). In a zig-zag scan order,such as the scan order 602, the top left corner of the transform block(also known as the DC coefficient) is first traversed and encoded, thenext coefficient in the scan order (i.e., the transform coefficientcorresponding to the location labeled “1”) is traversed and encoded, andso on. In the zig-zag scan order (i.e., scan order 602), some quantizedtransform coefficients above and to the left of a current quantizedtransform coefficient (e.g., a to-be-encoded transform coefficient) aretraversed first. Other scan orders are possible. A one-dimensionalstructure (e.g., an array) of quantized transform coefficients canresult from the traversal of the two-dimensional quantized transformblock using the scan order.

In some examples, encoding the quantized transform block 604 can includedetermining the non-zero map 606, which indicates which quantizedtransform coefficients of the quantized transform block 604 are zero andwhich are non-zero. A non-zero coefficient and a zero coefficient can beindicated with values one (1) and zero (0), respectively, in thenon-zero map. For example, the non-zero map 606 includes a non-zero 607at Cartesian location (0, 0) corresponding to the coefficient 608 and azero 608 at Cartesian location (2, 0) corresponding to the coefficient610. In some cases, the non-zero map may be referred to as thesignificance map.

In some examples, encoding the quantized transform block 604 can includegenerating the end-of-block map 622. The end-of-block map indicateswhether a non-zero quantized transform coefficient of the quantizedtransform block 604 is the last non-zero coefficient with respect to agiven scan order. If a non-zero coefficient is not the last non-zerocoefficient in the transform block, then it can be indicated with thebinary value 0 (zero) in the end-of-block map. If, on the other hand, anon-zero coefficient is the last non-zero coefficient in the transformblock, then it can be indicated with the binary value 1 (one) in theend-of-block map. For example, as the quantized transform coefficientcorresponding to the scan location 11 (i.e., the last non-zero quantizedtransform coefficient 628) is the last non-zero coefficient of thequantized transform block 604, it is indicated with the end-of-blockvalue 624 of 1 (one); all other non-zero transform coefficients areindicated with a zero.

In some examples, encoding the quantized transform block 604 can includegenerating the sign map 626. The sign map 626 indicates which non-zeroquantized transform coefficients of the quantized transform block 604have positive values and which quantized transform coefficients havenegative values. Transform coefficients that are zero need not beindicated in the sign map. The sign map 626 illustrates the sign map forthe quantized transform block 604. In the sign map, negative quantizedtransform coefficients can be indicated with a −1 and positive quantizedtransform coefficients can be indicated with a 1.

FIG. 7A is a block diagram of an encoder 700 that separately encodesquantized coefficients and an intra-prediction mode. The encoder 700 canbe an example of the encoder 400 of FIG. 4. The encoder 700 does not useinformation in residual blocks to improve the compression performance ofintra-prediction modes. The encoder 700 can receive a block 701 of videoand produces a bitstream 720. That is, the encoder 700 receives theblock 701 and outputs to the bitstream 720 an encoding for the block701. The encoder 700 includes a mode decision 702, an intra prediction704, a transform/quantization 708, an inverse quantization/transform722, an entropy encoder 712, an entropy encoder 716, and a multiplexer718.

The block 701 can be a block of the input video stream 300 of FIG. 4.The bitstream 720 can be the compressed bitstream 420 of FIG. 4. Themode decision 702 and the intra prediction 704 can be, can beimplemented by, or can be implemented similarly to, the intra/interprediction stage 402 of FIG. 4. The transform/quantization 708 can be,can be implemented by, or can be implemented similarly to, the transformstage 404 and the quantization stage 406 of FIG. 4. The inversequantization/transform 722 can be, can be implemented by, or can beimplemented similarly to, the dequantization stage 410 and the inversetransform stage 412 of FIG. 4. The entropy encoder 712 can be, can beimplemented by, or can be implemented similarly to, the entropy encodingstage 408 of FIG. 4. The entropy encoder 712 and the entropy encoder 716can be the same entropy encoder. The entropy encoder 716 can be separatefrom, but functionally similar to, the entropy encoder 712.

An intra-prediction mode 714 for encoding the block 701 can bedetermined by the mode decision 702. The intra prediction 704 canpredict the block 701 using the intra-prediction mode 714 determined bythe mode decision 702. The encoder 700 generates a residual block 706,as described with respect to FIG. 4. The transform/quantization 708transforms the residual block into a transform block and quantizes thetransform block to produce a quantized transform block of quantizedtransform coefficients 710.

The intra-prediction mode 714, determined by the mode decision 702, isreceived by the entropy encoder 716. The entropy encoder 716 produces anentropy coded intra-prediction mode. The quantized transformcoefficients 710 are received by the entropy encoder 712. The entropyencoder 712 produces entropy encoded quantized coefficients. The entropycoded intra-prediction mode and the entropy encoded quantizedcoefficients can be multiplexed (e.g., added) into the bitstream 720 bythe multiplexer 718.

FIG. 7B is a block diagram of a decoder 750 that separately decodesquantized coefficients and an intra-prediction mode. The decoder 750 canbe an example of the decoder 500 of FIG. 5. The decoder 750 does not useinformation in residual blocks (e.g., information in quantized transformblocks) encoded by an encoder to decode intra-prediction modes. Thedecoder 750 can receive a bitstream 720 of video and produces areconstructed block 764 of video. The decoder 750 includes ade-multiplexer 752, an entropy decoder 756, an entropy decoder 754, aninverse quantization/transform 760, and an intra prediction 768.

The bitstream 720 can contain a current block of the input video to bereconstructed (i.e., decoded). The bitstream 720 can be the compressedbitstream 420 of FIG. 5. The reconstructed block 764 can be a block ofthe output video stream 516 of FIG. 5. The entropy decoder 754 can be,can be implemented by, or can be implemented similarly to, the entropydecoding stage 502 of FIG. 54. The entropy decoder 756 and the entropydecoder 754 can be the same entropy decoder. The entropy decoder 756 canbe separate from, by functionally similar to, the entropy decoder 754.The inverse quantization/transform 760 can be, can be implemented by, orcan be implemented similarly to, the dequantization stage 504 and theinverse transform stage 506 of FIG. 5. The intra prediction 768 can be,can be implemented by, or can be implemented similarly to, theintra/inter-prediction stage 508 of FIG. 5.

The de-multiplexer 752 receives and extracts from the bitstream 720 theentropy coded intra-prediction mode and the entropy coded quantizedtransform coefficients. The entropy decoder 756 decodes the entropycoded quantized transform coefficients to produce quantized transformcoefficients 758. The inverse quantization/transform 760 uses thequantized transform coefficients 758 to produce residual block 762. Inparallel (i.e., separately), the entropy decoder 754 decodes anintra-prediction mode 766 from the entropy coded intra-prediction mode.The intra-prediction mode 766 can be used by the intra prediction 768 togenerate a prediction block. The decoder 750 uses the prediction blockand the residual block 762 to generate the reconstructed block 764.

FIG. 8A is a block diagram of an encoder 800 that uses theintra-prediction mode to encode the quantized coefficients. The encoder800 can be an example of the encoder 400 of FIG. 4. The encoder 800includes some of the same components as those of the encoder 700.Descriptions of components of the encoder 800 that are common with theencoder 700 are omitted. The encoder 800 includes an entropy encoder 804in place of the entropy encoder 712 of FIG. 7. The entropy encoder 804receives, along path 802, the intra-prediction mode 714 determined bythe mode decision 702. As such, in coding the residual block 706 (i.e.,after the intra prediction 704 and the transform/quantization 708), theencoder 800 can use the intra-prediction mode. For example, the encoder800 selects a coding context for encoding the quantized transformcoefficients of a transform block based on the intra-prediction mode714.

The encoder 800 may include a number of intra-prediction modes. Forexample, the encoder 800 (and any other encoder according toimplementations of this disclosure) can include 35 intra-predictionmodes. For example, the intra-prediction modes can include a planarintra-prediction mode (also referred to as mode 0), a DCintra-prediction mode (also referred as mode 1), and angular predictionmodes (e.g., mode 2 to mode 34).

The intra-prediction modes can be classified into classes. The classescan include: horizontal, vertical, and diagonal or other. Horizontalintra-prediction modes are directional prediction modes (e.g., modes6-14) whose intra-prediction angles are close to the horizontal axis(i.e., are generally horizontal). Vertical intra-prediction modes aredirectional intra-prediction modes (e.g., modes 22-30) whose predictionangles are close to the vertical axis (i.e., are generally vertical).Diagonal or other intra-prediction modes are all the remainingdirectional (which are neither horizontal nor vertical) andnon-directional intra-prediction modes. The diagonal or otherintra-prediction modes are the intra-prediction modes 0-5, 15-21, and31-34. “Diagonal or other” may be referred to herein, collectively, as“diagonal.”

A description is now given as to how the encoder 800 can use theintra-prediction mode to encode the quantized coefficients. Let m denotethe intra-prediction mode 714 used to generate the residual block 706,and let c(m) denote the class into which the intra-prediction mode m isclassified. For example, m can have a value equal to, or correspondingto, one of the intra-prediction modes 0 to 34. Depending on theintra-prediction angle, the classification c(m) of the intra-predictionmode m can be one of horizontal, vertical, and diagonal or other. Forexample, if the prediction angle is more horizontal than vertical, thenthe intra-prediction mode can be classified as horizontal (i.e.,c(m)=horizontal). If the prediction angle is more vertical thanhorizontal or diagonal, then the intra-prediction mode can be classifiedas vertical (i.e., c(m)=vertical). Otherwise, the intra-prediction modecan be classified as diagonal (i.e., c(m)=diagonal). A classification of“diagonal” includes diagonal and other.

The encoder 800 can use the classification c(m) to derive one or morecontext models to be used for encoding the non-zero map, such as thenon-zero map 606 of FIG. 6, in a 4×4 or 8×8 luminance residual block.The encoder 800 can use the classification c(m) to determine a scanorder to use in encoding (and by a corresponding decoder, such asdecoder 850 described below, in decoding) the quantized transformcoefficients. For example, the encoder 800 can select a vertical scanorder when the classification c(m) is horizontal, can select ahorizontal (raster) scan order when the classification c(m) is vertical,and can select a diagonal scan order when the classification c(m) isdiagonal.

FIG. 8B is a block diagram of a decoder 850 that uses theintra-prediction mode to decode the quantized coefficients. The decoder850 uses information in residual blocks (e.g., information in thequantized transform coefficients) encoded by an encoder, such as theencoder 800 of FIG. 8A, to improve the compression performance of thequantized transform coefficients. The decoder 850 receives a bitstream720 of video and produces a reconstructed block 764 of video. Thedecoder 850 includes the de-multiplexer 752, the entropy decoder 754, anentropy decoder 855, the inverse quantization/transform 760, and theintra prediction 768.

The bitstream 720 can contain a current block of the input video to bereconstructed (i.e., decoded). The bitstream 720 can be the compressedbitstream 420 of FIG. 5. The reconstructed block 764 can be a block ofthe output video stream 516 of FIG. 5. The entropy decoder 754 can be,can be implemented by, or can be implemented similarly to, the entropydecoding stage 502 of FIG. 54. The inverse quantization/transform 760can be, can be implemented by, or can be implemented similarly to, thedequantization stage 504 and the inverse transform stage 506 of FIG. 5.The intra prediction stage 508 can be, can be implemented by, or can beimplemented similarly to, the intra/inter-prediction stage 508 of FIG.5.

The de-multiplexer 752 receives the bitstream 720. The de-multiplexerextracts, from the bitstream 720, the entropy coded intra-predictionmode and the entropy coded quantized transform coefficients. The entropydecoder 754 decodes the entropy coded intra-prediction mode to generatethe intra-prediction mode 766. The entropy decoder 855 receives theintra-prediction mode 766, along path 852, and receives the entropycoded quantized transform coefficients to generate the quantizedtransform coefficients 758. That is, the entropy decoder 855 can use theintra-prediction mode to determine a context model for decoding thequantized coefficients of the transform block. The inversequantization/transform 760 uses the quantized transform coefficients 758to produce residual block 762. The intra-prediction mode 766 can be usedby the intra prediction stage 508 to generate a prediction block. Thedecoder 750 uses the prediction block and the residual block 762 togenerate the reconstructed block 764.

FIG. 9 is a flowchart diagram of a process 900 for coding a currentblock using an intra-prediction mode according to an implementation ofthis disclosure. In some examples, coding means encoding, such as by anencoder. In other examples, coding means decoding, such as by a decoder.The process 900 can be implemented, for example, as a software programthat can be executed by computing devices such as the transmittingstation 102 or the receiving station 106. The software program caninclude machine-readable instructions that can be stored in a memorysuch as the memory 204 or the secondary storage 214, and that can beexecuted by a processor, such as CPU 202, to cause the computing deviceto perform the process 900.

The process 900 can be implemented using specialized hardware orfirmware. Some computing devices can have multiple memories, multipleprocessors, or both. The steps or operations of the process 900 can bedistributed using different processors, memories, or both. Use of theterms “processor” or “memory” in the singular encompasses computingdevices that have one processor or one memory as well as devices thathave multiple processors or multiple memories that can be used in theperformance of some or all of the recited steps.

The process 900 can be implemented in an encoder such as the encoder 400of FIG. 4. In at least some implementations, the process 900 can beperformed at least in part by the entropy encoding stage 408 of theencoder 400 of FIG. 4. When implemented by an encoder, the process 900can encode the current block using an intra-prediction mode. The process900 can be implemented in a decoder such as the decoder 500 of FIG. 5.In at least some implementations, the process 900 can be performed atleast in part by the entropy decoding stage 502 of the decoder 500 ofFIG. 5. When implemented by a decoder, the process 900 can decode thecurrent block using the intra-prediction mode.

At 902, the process 900 receives a block of quantized transformcoefficients. When implemented in an encoder, the process 900 canreceive the block of quantized transform coefficients generated asdescribed above with respect to FIGS. 4 and 7A. For example, the process900 can receive the block of quantized transform coefficients generatedby quantization stage 406. When implemented in a decoder, the process900 can receive the block of quantized transform coefficients in anencoded bitstream as described above with respect to FIGS. 5 and 7B.

At 904, the process 900 determines a context for coding theintra-prediction mode using the quantized transform coefficients. Whenimplemented by an encoder, the process 900 determines the context (i.e.,context model) for encoding the intra-prediction mode in the encodedbitstream. When implemented by a decoder, the process 900 determines thecontext for decoding the intra-prediction mode from the encodedbitstream.

Encoding the intra-prediction mode involves binarizing (i.e., convertingto a binary code) the magnitude of a value corresponding to theintra-prediction before encoding the binarized value using the contextmodel. The context model provides estimates of conditional probabilitiesfor coding the binary symbols of a binarized intra-prediction mode.Improving the coding context can result in using less bits to encode(i.e., entropy encode) the possible values of intra-prediction modes.

Implementations according to this disclosure leverage principles ofinformation theory to improve the coding of intra-prediction modes. LetX and Y denote two random variables with finite alphabets (i.e.,possible values). Using the chain rule, the joint entropy H(X,Y) of Xand Y can be decomposed as given by equation (1):

H(X,Y)=X(X)+H(Y|X)=H(Y)+H(X|Y)  (1)

In equation (1), H(X) and H(Y) denote the marginal entropy of X and Y,respectively, H(Y|X) denotes the conditional entropy of Y given X, andH(X|Y) denotes the conditional entropy of X given Y. If X denotes theresidual block and Y denotes the intra-prediction mode associated withthe residual block X, and in the case where the residual block Y and theintra-prediction mode X are correlated, then it follows from the chainrule that H(Y|X)<H(Y). That is, encoding the intra-prediction mode(i.e., Y) using information in the residual block (i.e., H(Y|X)) resultsin more compression than directly encoding the intra-prediction mode(i.e., H(Y)). As such, compression performance can be improved byleveraging the information of the residual block (i.e., X) in coding theintra-prediction mode (i.e., Y).

Using information in the residual block includes using information inthe residual block itself, using information in the correspondingtransform block, or using information in the corresponding quantizedtransform block. If I(X;Y) denotes the mutual information between X(i.e., the residual block) and Y (i.e., the intra-prediction mode),equation (1) results in I(X;Y)=H(Y)−H(Y|X)>0.

The process 900 can leverage the correlation between the residual blockand the intra-prediction mode for encoding and decoding theintra-prediction mode. For example, the correlation can be expressed as:if the prediction angle is close to the horizontal axis (i.e., isgenerally horizontal), the non-zero quantized transform coefficients aremore likely to appear in the first several columns of the quantizedtransform block; and if the prediction angle is close to the verticalaxis (i.e., is generally vertical), the quantized transform coefficientsare more likely to appear in the first several rows of the quantizedtransform block.

In an example, determining the coding context can include determining acategory for the intra-prediction mode using the quantized transformcoefficients of the quantized transform block. The category can have avalue that is selected from a set that includes a first category valueand a second category value. The set can include other values. In anexample, determining the coding context can be based on a comparison ofa first number of non-zero coefficients in a row of the quantizedtransform block to a second number of non-zero coefficient in a columnof the quantized transform block. The determination can be made using anon-zero map, such as the non-zero map 606 of FIG. 6.

In an example, determining a category for the intra-prediction modeincludes determining a difference between a first number of non-zerocoefficients in a row of the quantized transform block and a secondnumber of non-zero coefficient in a column of the quantized transformblock. The row can be a first row (e.g., top-most row) of the quantizedtransform block and the column can be a first column (e.g., left-mostcolumn) of the quantized transform block. The first row can include morethan the top-most row and the first column can include more than theleft-most column. For example, the number of rows and columns can dependon the size of the block. For example, for an 8×8 block, the first rowcan include the two top-most rows and the first column can include thetwo left-most columns, and for a 32×32 block, the first row can includethe four top-most rows and the first column can include the fourleft-most columns.

Determining the category for the intra-prediction mode can also include,on condition that the difference is greater than a first threshold,setting the category to a first category value and, on condition thatthe difference is less than a second threshold, setting the category toa second category value. That is, the category can be set to one or afirst category value and a second category value based on thecomparison. Determining the category for the intra-prediction mode canalso include, on condition that the difference is not greater than thefirst threshold and is not less than the second threshold, setting thecategory to a third category. The first category, the second category,and the third category can indicate, respectively, that theintra-prediction mode is generally horizontal, generally vertical, andneither horizontal nor vertical (i.e., diagonal).

For example, let r[i] denote the number of non-zero coefficients in thei-th row of the quantized transform block, and let c[j] denote thenumber of non-zero coefficients in the j-th column of the quantizedtransform block, where i=0, 1, . . . , N−1 and j=0, 1, . . . , N−1 for aN×N block. In FIG. 6, for example, N is equal to 4 corresponding to thesize of the block 604. The number of non-zero coefficients in the 0-throw (i.e., row 614) is r[0]=3; the number of non-zero coefficients inthe 1-st row (i.e., row 618) is r[1]=2; the number of non-zerocoefficients in the 0-th column (i.e., column 612) is c[0]=3; and thenumber of non-zero coefficients in the 1-st column (i.e., column 616) isc[1]=1. The number of non-zero quantized transform coefficients in a row(i.e., r[i]) or a column (i.e., c[i]) can be determined using thenon-zero map 606.

The process 900 can compare the number of non-zero coefficients in thefirst row (i.e., r[0]=3) to the number of non-zero coefficients in thefirst column (i.e., c[0]=3). The number of non-zero coefficients can becompared to determine a category t of the intra-prediction mode. In anexample, the category t can have the values 1, 2, and 0 corresponding,respectively, to a horizontal intra-prediction mode, a verticalintra-prediction mode, and neither horizontal nor verticalintra-prediction mode (i.e., diagonal). The compression gain of anencoder can be related to the number of possible values of the categoryt. If the category t can have three (3) values (e.g., 0, 1, 2), then thecompression gain in encoding the intra-prediction mode can be log₂(3)(i.e., 2) bits for each block that is encoded using intra prediction.

In one example, the process 900 can determine the category t usingalgorithm (2):

$\begin{matrix}\left\{ \begin{matrix}{{{{{if}\mspace{14mu} {c\lbrack 0\rbrack}} - {r\lbrack 0\rbrack}} > {{first}\mspace{14mu} {threshold}}},{{{then}\mspace{14mu} {set}\mspace{14mu} t} = 1}} \\{{{{{if}\mspace{14mu} {r\lbrack 0\rbrack}} - {c\lbrack 0\rbrack}} > {{second}\mspace{14mu} {threshold}}},{{{then}\mspace{14mu} {set}\mspace{14mu} t} = 2}} \\{{otherwise},{{{set}\mspace{14mu} t} = 0}}\end{matrix} \right. & (2)\end{matrix}$

That is, if the number of non-zero quantized transform coefficients inthe first column (i.e., c[0]) is greater than the number of non-zeroquantized transform coefficients in the first row (i.e., r[0]) by atleast a first threshold, then the intra-prediction mode can becategorized as a horizontal intra-prediction mode (i.e., t=1). If thenumber of non-zero quantized transform coefficients in the first row(i.e., r[0]) is greater than the number of non-zero quantized transformcoefficients in the first column (i.e., c[0]) by at least the secondthreshold, then the intra-prediction mode can be categorized as avertical intra-prediction mode (i.e., t=2). Otherwise, theintra-prediction mode can be categorized as diagonal. As describedabove, the planar intra-prediction mode and the DC intra-prediction modecan be categorized as “diagonal.” A category of t=0 (i.e., diagonal) canindicate that the non-zero quantized coefficients are spread throughoutthe quantized transform block (i.e., not concentrated enough in rows orcolumns) and, as such, the intra-prediction mode cannot be determined tobe horizontal or vertical.

In an example, the first threshold and/or the second threshold canrelate to the size of the block of quantized transform coefficients. Forexample, for a quantized transform block of size N×N, the firstthreshold can be set to N/4 and the second threshold can be set to N/4.The first threshold and the second threshold can have other values thatmay, but need not, be related to the quantized transform block size.

Applying the algorithm (2) to the quantized transform block 604 of FIG.6 results in the category t=0. As described above, r[0]=3 and c[0]=3. Asr[0]−c[0] (i.e., 3−3=0) is not greater than N/4 (i.e., 4/4=1) andc[0]−r[0] (i.e., 0) is also not greater than N/4, the category t is setto 0.

In an example, if the category of intra-prediction mode cannot bedetermined to be either horizontal or vertical based on a comparison ofthe number of non-zero quantized transform coefficients in a first row(e.g., the top-most row) of the quantized transform block to the numberof non-zero quantized transform coefficients of a first column (e.g.,left most column) of the quantized transform block, then a comparisoncan be made for additional rows and columns. For example, on conditionthat the difference is not greater than the first threshold and is notless than the second threshold, determining the category based on acomparison of a third number of non-zero coefficients in a second row ofthe quantized transform block to a fourth number of non-zero coefficientin a second column of the quantized transform block. The first row andthe second row are different rows of the quantized transform block. Thefirst column and the second column are different columns of thequantized transform block.

In an example, determining the coding context for the intra-predictionmode can include determining a first coding context using previouslycoded intra-prediction modes and determining the coding context usingthe first coding context and the category. The first coding context canbe a coding context that is derived based on previously decodedintra-prediction modes and/or previously decoded blocks. The category tcan be used to refine the first coding context to determine the codingcontest that can provide better compression than the first codingcontext. For example, if the first coding context has one value (e.g.,an index of a coding context), the category t can be used to split thevalue into three (e.g., each value corresponding to a possible value oft) different context index values.

The process 900 can determine a first coding context, intra_mode_ctx, asdescribed with respect to the entropy encoder 716 of FIG. 7A. The firstcoding context, intra_mode_ctx, can be selected from a first set ofcoding contexts for the intra-prediction mode. The first coding contextintra_mode_ctx can be the index of selected context of the set of codingcontexts for the intra-prediction mode. The coding context,new_intra_mode_ctx, can be determined as a function of the first codingcontext, intra_mode_ctx and the category t as

new_intra_mode_ctx=ƒ(intra_mode_ctx,t)  (3)

The function ƒ of equation (3) can be a function that maps(intra_mode_ctx, t) into an index in an allowable range of availablecoding contexts. Any number of mapping functions can be available aslong as there exists at least one intra_mode_ctx such that(intra_mode_ctx, t) is mapped to at least two distinct indices. In otherwords, for the at least one intra_mode_ctx, there exist two values of t,t_(a) and t_(b), such that t_(a)≠t_(b) and (intra_mode_ctx,t_(a))≠(intra_mode_ctx, t_(b)). An example of a mapping function f canbe given by equation (4) below. Another example can be given by equation(5)

ƒ(intra_mode_ctx,t)=t*NUM_CONTEXTS+intra_mode_ctx  (4)

ƒ(intra_mode_ctx,t)=intra_mode_ctx*3+t.  (5)

In equation (4), NUM_CONTEXTS can be the number of distinct values ofintra_mode_ctx (i.e., the number of context models in the set of codingcontexts for the intra-prediction mode). The process 900 can haveavailable more context models to select the coding context (i.e.,new_intra_mode_ctx) than are available for selecting intra_mode_ctx. Assuch, an encoder that implements the process 900, such as the encoder1000 of FIG. 10 (described below), can have available to anintra-prediction entropy encoder, such as the entropy encoder 1002,additional coding contexts than the entropy encoder 716 of the encoder700 of FIG. 7. The coding contexts available to the entropy encoder 1002of FIG. 10 can include the coding contexts available to the entropyencoder 716.

At 906, the process 900 codes the intra-prediction mode using the codingcontext. When implemented by an encoder, coding the intra-predictionmode using the coding context includes encoding, in an encodedbitstream, the intra-prediction mode using the context. When implementedby a decoder, coding the intra-prediction mode using the coding contextincludes decoding, from an encoded bitstream, the intra-prediction modeusing the context.

In some implementations, the process 900, at 904, can use a portion of arow and a portion of a column of the quantized transform block todetermine the category t. The portion can be any contiguous ornon-contiguous portion. In an example, the portion of the row (column)can be the second half of the row (column). That is, for a quantizedtransform block of size N×N where a row Row(i) (Column(i)) includes thequantized transform coefficients Row(i, x) (Column(x, i)), where x=0, 1,. . . , N−1, the second half of the row (column) includes the quantizedtransform coefficients Row(i, m) (Column(m, i)), where m=N/2, . . . ,N−1. If r[i] denotes the number of non-zero coefficients in the secondhalf of the i-th row and let c[j] denote the number of non-zerocoefficients in the second half of the j-th column, then the category tcan be determined using algorithm (6):

$\begin{matrix}\left\{ \begin{matrix}{{{{if}\mspace{14mu} {c\lbrack 0\rbrack}} > {0\mspace{14mu} {and}\mspace{14mu} {r\lbrack 0\rbrack}}==0},{{{set}\mspace{14mu} t} = 1}} \\{{{{if}\mspace{14mu} {r\lbrack 0\rbrack}} > {0\mspace{14mu} {and}\mspace{14mu} {c\lbrack 0\rbrack}}==0},{{{set}\mspace{14mu} t} = 2}} \\{{otherwise},{{{set}\mspace{14mu} t} = 0}}\end{matrix} \right. & (6)\end{matrix}$

In algorithm (6), if the first column of the quantized transform blockincludes non-zero quantized transform coefficients in the second portionof the first column (i.e., c[0]>0) and there are no non-zero quantizedtransform coefficients in the second portion of the first row (i.e.,r[0]==0), then the category t is set to 1 indicating, for example, agenerally horizontal intra-prediction mode. If the first row of thequantized transform block includes non-zero quantized transformcoefficients in the second portion of the first row (i.e., r[0]>0) andthere are no non-zero quantized transform coefficients in the secondportion of the first column (i.e., c[0]==0), then the category t is setto 2 indicating, for example, a generally vertical intra-predictionmode. Otherwise, the category t is to zero indicating, for example,neither horizontal nor vertical intra-prediction mode. In some examples,instead of setting the category t to 0 after evaluating the portions ofthe first row and column, the algorithm (6) can be applied to anotherrow and column. The process 900 can be applied repeatedly up to apredetermined number of rows and columns until a category of 1 or 2 canbe set for the category t. For example, the process 900 can stop afterN/2 rows and columns are examined.

The algorithm (6) can use thresholds other than 0 to determine thecategory t. For example, the category can be determined using algorithm(7):

if c[0]>third threshold and r[0]≤fourth threshold, set t=1

if r[0]>third threshold and c[0]≤fourth threshold, set t=2

otherwise, set t=0  (7)

In algorithm (7), the third threshold and the fourth threshold can besuch that 0≤fourth threshold≤third threshold.

In yet another example, the process 900 can determine the category tusing the values of the quantized transform coefficients. For example,the absolute values of the coefficients can be used. For example, letr[i] denote the sum of the absolute values of the quantized transformcoefficients in the i-th row of the quantized transform block and letc[i] denote the sum of the absolute values of the quantized transformcoefficients of the transform block in the j-th column. The value ofcategory t can be determined using algorithm (8):

$\begin{matrix}\left\{ \begin{matrix}{{{{if}\mspace{14mu} {c\lbrack 0\rbrack}} > {2*{r\lbrack 0\rbrack}}},{{{set}\mspace{14mu} t} = 1}} \\{{{{if}\mspace{14mu} {r\lbrack 0\rbrack}} > {2*{c\lbrack 0\rbrack}}},{{{set}\mspace{14mu} t} = 2}} \\{{otherwise},{{{set}\mspace{14mu} t} = 0}}\end{matrix} \right. & (8)\end{matrix}$

In algorithm (8), if the total sum of the absolute values of thequantized transform coefficients in the first column is greater thantwice the total sum of the absolute values of the quantized transformcoefficients in the first row, then the category t is set to 1indicating, for example, a generally horizontal intra-prediction mode.If the total sum of the absolute values of the quantized transformcoefficients in the first row is greater than twice the total sum of theabsolute values of the quantized transform coefficients in the firstcolumn, then the category t is set to 2 indicating, for example, agenerally vertical intra-prediction mode. Otherwise, the category t isset to 0.

While the category t is described as having the values 0, 1, and 2,implementations according to this disclosure are no so limited. Thecategory t can have any number of values. For example, additional valuesof the category t can be used to provide additional granularityregarding the angle of the horizontal and vertical intra-predictionmodes.

In an implementation, the process 900 can include determining anintra-prediction mode predictor p using the quantized transformcoefficients and encoding whether the intra-prediction mode predictorand the intra prediction mode are the same. The intra-prediction modepredictor p inversely predicts the intra-prediction mode based on thedistribution of the decoded quantized transform coefficients. If, forexample, the decoded non-zero quantized transform coefficients areskewed toward the first several columns of the quantized transformblock, then a generally horizontal intra-prediction mode can beselected. If the decoded non-zero quantized transform coefficients areskewed toward the first several rows of the quantized transform block,then a generally vertical intra-prediction mode can be selected.

The intra-prediction mode predictor p can be determined using asignificance map of the quantized transform coefficients. Thesignificance map can be as described with respect to the non-zero map606 of FIG. 6. In another example, the intra-prediction mode predictor pcan be a function of the absolute values of the quantized transformcoefficients or a function of the squared values of the quantizedtransform coefficients. The squared values of the quantized transformcoefficients can be indicative of the distribution of energy in theblock of quantized transform coefficients. For example, theintra-prediction mode predictor p can indicate a generally verticalintra-prediction mode when the energy is concentrated in, e.g., thefirst several rows of the block of quantized transform coefficients, andcan indicate a generally horizontal intra-prediction mode when theenergy is concentrated in, e.g., the first several columns of block ofquantized transform coefficients. The intra-prediction mode predictor pcan then be selected according to where the energy is concentrated.

The process 900 can determine the intra-prediction mode predictor pbased on a comparison of a number of non-zero quantized coefficients inrows and columns of the quantized transform block as described above.The intra-prediction mode predictor p can be indicative of theprediction angle. In an example, the intra-prediction mode predictor pcan have the value of an intra-prediction mode that is generallyhorizontal or generally vertical. For example, and using theintra-prediction modes described with respect to FIG. 8 as anillustration, the intra-prediction mode predictor p can have a valuecorresponding to one of the horizontal intra-prediction modes (e.g.,modes 6-14) or one of the vertical intra-prediction modes (e.g., modes22-30).

The process 900, when implemented by an encoder, can set a syntaxelement to a value (e.g., 0) when the intra-prediction mode predictorand the intra prediction mode are the same. If the indicators indicatesthat the intra-prediction mode m is equal to the intra-prediction modepredictor p (i.e., m=p), then a decoder can use the encodedintra-prediction mode to decode the current block. The syntax elementcan be set another value (e.g., 1), followed by an encoding of theintra-prediction mode, when the intra-prediction mode predictor and theintra prediction mode are not the same.

As another example, the intra prediction mode m can be encoded (anddecoded by a decoder such as a decoder 1200 of FIG. 12) differentiallyby, for example, encoding the difference between the intra predictionmode m and the intra-prediction mode predictor p (i.e., m−p).

As the quantized transform coefficients are available at a decoder(e.g., in an encoded bitstream), the decoder can determine the categoryt and the intra prediction mode predictor p from the quantized transformcoefficients as described above.

FIG. 10 is an example of an encoder 1000 according to implementations ofthis disclosure. The encoder 1000 can implement the process 900 anddepicts, in more detail, aspects of the encoder 400 of FIG. 4.

The encoder 1000 can use information in residual blocks to improve thecompression performance of intra-prediction modes. The encoder 1000includes some of the same components as those of the encoder 700.Descriptions of components of the encoder 1000 that are common with orsimilar to, the encoder 700 are omitted. The encoder 1000 includes themode decision 702, the intra prediction 704, the transform/quantization708, the inverse quantization/transform 722, an entropy encoder 1002,the entropy encoder 712, and the multiplexer 718. In an example, theencoder 1000 can provide improvements to the encoder 700 of FIG. 7. Forexample, the encoder 1000 can provide the entropy encoder 1002, in placeof the entropy encoder 716 of the encoder 700 of FIG. 7, according toimplementations of this disclosure.

The block 701 can be a block of the input video stream 300 of FIG. 4.The bitstream 720 can be the compressed bitstream 420 of FIG. 4. Themode decision 702 and the intra prediction 704 can be, can beimplemented by, or can be implemented similarly to, the intra/interprediction stage 402 of FIG. 4. The transform/quantization 708 can be,can be implemented by, or can be implemented similarly to, the transformstage 404 and the quantization stage 406 of FIG. 4. The inversequantization/transform 722 can be, can be implemented by, or can beimplemented similarly to, the dequantization stage 410 and the inversetransform stage 412 of FIG. 4. The entropy encoder 1002 can be, can beimplemented by, or can be implemented similarly to, the entropy encodingstage 408 of FIG. 4. The entropy encoder 1002 and the entropy encoder712 can be the same entropy encoder. The entropy encoder 1002 can beseparate from, by functionally similar to, the entropy encoder 712.

An intra-prediction mode 714 for encoding the block 701 can bedetermined by the mode decision 702. The intra prediction 704 can encodethe block 701 using the intra-prediction mode 714 determined by the modedecision 702. The encoder 700 generates a residual block 706, asdescribed with respect to FIG. 4. The transform/quantization 708transforms the residual block into a transform block and quantizes thetransform block to produce a quantized transform block of quantizedtransform coefficients 710.

The entropy encoder 712 produces entropy encoded quantized coefficients.The entropy encoder 1002 receives the intra-prediction mode 714determined by the mode decision 702 and receives, along path 1004, thequantized transform coefficients 710. The entropy encoder 1002 uses thequantized transform coefficients 710, as described with respect to FIG.9, to encode the intra-prediction mode. Encoding the intra-predictionmode can include determining a context model for encoding theintra-prediction mode. The entropy encoded intra-prediction mode and theentropy encoded quantized coefficients can be multiplexed (e.g., added)into the bitstream 720 by the multiplexer 718.

FIG. 11 is a flowchart diagram of a process 1100 for decoding a currentblock using an intra-prediction mode according to an implementation ofthis disclosure. The process 1100 can be implemented, for example, as asoftware program that can be executed by computing devices such as thetransmitting station 102 or the receiving station 106. The softwareprogram can include machine-readable instructions that can be stored ina memory such as the memory 204 or the secondary storage 214, and thatcan be executed by a processor, such as CPU 202, to cause the computingdevice to perform the process 1100.

The process 1100 can be implemented using specialized hardware orfirmware. Some computing devices can have multiple memories, multipleprocessors, or both. The steps or operations of the process 1100 can bedistributed using different processors, memories, or both. Use of theterms “processor” or “memory” in the singular encompasses computingdevices that have one processor or one memory as well as devices thathave multiple processors or multiple memories that can be used in theperformance of some or all of the recited steps.

The process 1100 can be implemented in a decoder such as the decoder 500of FIG. 5. The process 1100 can be implemented in an encoder, such as inthe reconstruction path of the encoder 400 of FIG. 4.

At 1102, the process 1100 decodes, from an encoded bitstream, quantizedtransform coefficients of a quantized transform block.

At 1104, the process 1100 determines a category for the intra-predictionmode using the quantized transform coefficients. The category can be oneof horizontal, vertical, and other (i.e., not horizontal or vertical,e.g., diagonal). For example, the process 1100 can determine adistribution of the non-zero quantized transform coefficients, asdescribed above with respect to the process 900, to determine thecategory of the intra-prediction mode. For example, if the non-zerocoefficients of the quantized transform block are concentrated in thefirst several rows (e.g., the first row), then the intra-prediction modeis determined to be likely vertical; if the non-zero coefficients areconcentrated in the first several columns (e.g., the first column), thenthe intra-prediction mode is determined to be likely horizontal. If thenon-zero coefficients are not concentrated in rows or columns, then theintra-prediction mode is more likely to be diagonal (e.g., DC, planar,or a diagonal prediction mode). As such, depending on the distributionof the non-zero decoded quantized coefficients, the intra-predictionmode can be classified as described above with respect to the category t(e.g., into one three values).

In an example, decoding the current block using the category includesdetermining a first context for decoding the intra-prediction mode,determining a second context model using the category and the firstcontext, and decoding the intra-prediction mode using the secondcontext. The first context and the second context can be determined asdescribed above with the respect to FIG. 9. The first context can bedetermined using the intra-prediction modes of previously decodedblocks, the size of the current block, the color component of thecurrent block (e.g., luminance or chrominance), other criteria, or acombination thereof.

At 1106, the process 1100 decodes, from the encoded bitstream, thecurrent block using the category.

In some implementations, the process 1100 can include decoding, from theencoded bitstream, whether an intra-prediction mode predictor is thesame as the intra-prediction mode. The intra-prediction mode predictorcan be a prediction of the intra-prediction mode and is determined by anencoder using the quantized transform coefficients as described withrespect to FIG. 9.

FIG. 12 is an example of a decoder 1200 according to implementations ofthis disclosure. The decoder 1200 can implement the process 1100 anddepicts, in more detail, aspects of the decoder 500 of FIG. 5. Thedecoder 1200 can also implement the process 900.

The decoder 1200 can use quantized transform coefficient information inan encoded bitstream to determine an intra prediction mode for decodingthe current block. The encoded bitstream can be the bitstream 720 thatis received from, generated by, or output by an encoder such as theencoder 1000 of FIG. 10. The decoder 1200 generates the reconstructedblock 764.

The decoder 1200 includes some of the same components as those of thedecoder 750 of FIG. 7B. Descriptions of components of the decoder 1200that are common with, or similar to those of, the decoder 750 areomitted. The decoder 750 includes the de-multiplexer 752, the entropydecoder 756, an entropy decoder 1202, the inverse quantization/transform760, and intra prediction 768.

The entropy decoder 1202 receives, along path 1204, the quantizedtransform coefficients 758, which are entropy decoded by the entropydecoder 756. The entropy decoder 1202 also receives an entropy encodedintra-prediction mode from the de-multiplexer 752. The entropy decoder1202 can determine a category for the intra-prediction mode as describedwith respect to FIG. 1100. The entropy decoder 1202 uses the category ofthe intra-prediction mode and the quantized transform coefficients 758to decode the intra-prediction mode.

FIG. 13 is a flowchart diagram of a process 1300 for reconstructing acurrent block using an intra-prediction mode according to animplementation of this disclosure. The current block can bereconstructed from an encoded bitstream. The encoded bitstream can bethe bitstream 420 of FIG. 5. The bitstream can be the bitstream receivedby the reconstruction stage 414 and/or the bitstream of thereconstruction path of FIG. 4.

At 1302, the process 1300 decodes a block of quantized transformcoefficients from the encoded bitstream. Decoding the block of quantizedtransform coefficients can be as described with respect to the process900 at 902. At 1304, the process 1300 determines at least one contextfor the intra-prediction mode using the quantized transformcoefficients. Determining the context can be as described above withrespect to the process 900 at 904. The encoded bitstream can includemore than one intra-prediction modes for the current block. As such, atleast one intra-prediction mode can be determined using the quantizedtransform coefficients.

At 1306, the process 1300 decodes the intra-prediction mode from theencoded bitstream using the at least one context. At 1308, the process1300 reconstructs a residual block using the block of quantizedtransform coefficients. When the process 1300 is implemented in anencoder, reconstructing the residual block can be as described withrespect to the intra prediction 704 of FIG. 10. When the process 1300 isimplemented in a decoder, reconstructing the residual block can be asdescribed with respect to generating of residual block 762 of FIG. 12.

At 1310, the process 1300 reconstructs the current block using thereconstructed residual block and the intra-prediction mode. When theprocess 1300 is implemented in an encoder, reconstructing the currentblock can be as described with respect to the reconstruction path ofFIG. 4. When the process 1300 is implemented in a decoder,reconstructing the current block can be as described with respect togenerating the reconstructed block 764 of FIG. 12.

FIG. 15A is a diagram of an example of a set of scan orders 1500 for ablock that are adapted based on data of a first group of elements of theblock. The numbers shown in the cells of FIG. 15A are scan ordersequence numbers for respective elements of the block at thecorresponding locations within the block. The example set of scan orders1500 includes four scan orders: zig-zag, horizontal scan order 1510;zig-zag, vertical scan order 1520; zig-zag, zig-zag scan order 1530; andzig-zag, diagonal scan order 1540. In the example of FIG. 15A, the blockto be coded is partitioned into two groups of elements: a first groupthat is coded (e.g., encoded or decoded) first using a zig-zag scanorder reflected in the scan order sequence numbers 0-6 in the shadedcells of the diagram of FIG. 15A; and a second group that is coded(e.g., encoded or decoded) next using a scan order that is selected oradapted based on the elements from the first group. For example, ahorizontal scan order may be selected for the second group, resulting inthe zig-zag, horizontal scan order 1510 for the block. For example, avertical scan order may be selected for the second group, resulting inthe zig-zag, vertical scan order 1520 for the block. For example, azig-zag scan order may be selected for the second group, resulting inthe zig-zag, zig-zag scan order 1530 for the block. For example, adiagonal scan order may be selected for the second group, resulting inthe zig-zag, diagonal scan order 1540 for the block. In the example ofFIG. 15A, the first group includes elements of a first row of the blockand elements of a first column of the block. In the example of FIG. 15A,the second group includes all remaining elements of the block outside ofthe first group. For example, the elements of the block may be quantizedtransform coefficients. For example, the elements of the block may bequantized transform coefficients of a residual block (e.g., a residualblock resulting from intra-frame prediction or a residual blockresulting from inter-frame prediction).

FIG. 15B is a diagram of an example of a set of scan orders 1550 for ablock that are adapted based on a non-zero map for a first group ofelements of the block. The numbers shown in the cells of FIG. 15B arebinary non-zero map values for respective elements of the block at thecorresponding locations within the block. The example set of scan orders1550 includes four scan orders: zig-zag, horizontal scan order 1560;zig-zag, vertical scan order 1570; zig-zag, zig-zag scan order 1580; andzig-zag, diagonal scan order 1590. In the example of FIG. 15B, the blockto be coded is partitioned into two groups of elements: a first groupthat is coded (e.g., encoded or decoded) first using a zig-zag scanorder; and a second group that is coded (e.g., encoded or decoded) nextusing a scan order that is selected or adapted based on a distribution(e.g., counts in certain portions of the first group) of non-zeroelements from the first group. In the example of FIG. 15B, the firstgroup includes elements of a first row of the block and elements of afirst column of the block. In the example of FIG. 15B, the second groupincludes all remaining elements of the block outside of the first group.For example, a horizontal scan order may be selected for the secondgroup, resulting in the zig-zag, horizontal scan order 1560 for theblock, where a count of non-zero elements in the second half of thefirst row is positive and a count of non-zero elements in the secondhalf of the first column is zero. For example, a vertical scan order maybe selected for the second group, resulting in the zig-zag, verticalscan order 1570 for the block, where a count of non-zero elements in thesecond half of the first row is zero and a count of non-zero elements inthe second half of the first column is positive. For example, a zig-zagscan order may be selected for the second group, resulting in thezig-zag, zig-zag scan order 1580 for the block otherwise (e.g., where acount of non-zero elements in the second half of the first row ispositive and a count of non-zero elements in the second half of thefirst column is positive). For example, a diagonal scan order may beselected for the second group, resulting in the zig-zag, diagonal scanorder 1590 for the block otherwise (e.g., where a count of non-zeroelements in the second half of the first row is positive and a count ofnon-zero elements in the second half of the first column is positive).For example, the elements of the block may be quantized transformcoefficients. For example, the elements of the block may be quantizedtransform coefficients of a residual block (e.g., a residual blockresulting from intra-frame prediction or a residual block resulting frominter-frame prediction).

In some implementations (not shown), instead of using the zigzag scanorder for the first group, other scan orders may be used. For example,an alternating scan order S1 as follows may be used to map a scanposition k to a block position (e.g., Cartesian position).

S1[k]=(0,k>>1) if k is even

S1[k]=((k+1)>>1,0) if k is odd

where k=0, . . . , 2*N−2.

In some implementations (not shown in FIG. 15A), instead of using azig-zag scan order for the second group as shown in scan order 1530 ofFIG. 15A, other scan orders may be used, such as a transposed zig-zagscan order as shown in the table below:

7 8 12 9 11 13 10 14 15For example, a decision of whether to use the zig-zag scan order for thesecond block of scan order 1530 or the transposed zig-zag scan ordermight depend upon the number of the non-zero coefficients in the firstrow and the first column. If the former is larger, the transposedzig-zag scan order is used for the second group; otherwise the zig-zag,zig-zag scan order 1530 may be used.

In some implementations (not shown), a 225-degree diagonal scan order(downward to the left) may be used for a group of elements from theblock instead of the 45-degree diagonal scan order used for the secondgroup in scan order 1540 of FIG. 15A. For example, in a case where thechoice is to be made between the 45-degree diagonal scan order or the225-degree diagonal scan order, the 225-degree diagonal scan order maybe chosen if there are more non-zero coefficients in the first columnthan in the first row, and otherwise the 45-degree diagonal scan ordermay be chosen.

In some implementations, multi-level scan orders may be used. In thesecases, each element in FIGS. 15A and 15B may represent a sub-block ofquantized transform coefficients, and the scan order may be used todetermine the order to code (e.g., encode with an entropy encoder ordecode with an entropy decoder) these sub-blocks. For example, when anelement represents a sub-block, a zero in FIG. 15B may indicate thecorresponding sub-block consists of all zero coefficients, and one mayindicate the corresponding sub-block includes at least one non-zerocoefficient.

When multi-level scan orders are used, once the scan order is determinedfor sub-blocks, the scan order within a sub-block may be derivedsimilarly according to the example above. In some implementations, thescan order within a sub-block may inherit the scan order determined atthe sub-block level for the group including the element representing thesub-block. For example, each sub-block in 1560 may use the horizontalscan order, each sub-block in 1570 may use the vertical scan order, eachsub-block in 1580 may use the zig-zag scan order, and each sub-block in1590 may use the diagonal scan order.

FIG. 16 is a flowchart of an example of a process 1600 for adapting scanorder to encode a block of video data. The process 1600 includespartitioning 1610 a block of video data into a plurality of groups ofelements; encoding 1620, using an entropy encoder using a first scanorder, elements of a first group from the plurality of groups ofelements; selecting 1622 a next group from the plurality of groups;determining 1630, based on the elements of the prior group(s), a nextscan order for the next group; encoding 1640, using the entropy encoder,using the next scan order, elements of the next group; and continuing(at 1645) to process any remaining groups from the plurality of groupsuntil all groups have been encoded 1640 and then outputting 1650 theencoded elements of the block to a bitstream. For example, the process1600 may be implemented by the entropy encoder 712. For example, theprocess 1600 may be implemented by the transmitting station 102. Forexample, the process 1600 may be implemented by a computing device, suchas the computing device 200. For example, the process 1600 may beimplemented by a software program including machine-readableinstructions that can be stored in a memory such as the memory 204 orthe secondary storage 214, and that can be executed by a processor, suchas CPU 202, to cause a computing device to perform the process 1600. Forexample, the process 1600 may be implemented by an encoder such as theencoder 400 of FIG. 4. For example, the process 1600 may be implementedby the entropy encoding stage 408 of the encoder 400 of FIG. 4.

The process 1600 includes partitioning 1610 a block of video data into aplurality of groups of elements. The groups may be disjoint. The blockmay include a two-dimensional array of elements (e.g., a 4×4, 8×8,16×16, 32×32, or any other square or rectangular block size). A groupfrom the plurality of groups of elements may be continuous ordiscontinuous within the structure of the block. For example, theelements of the block may be pixel values (e.g., luminosity values). Forexample, the elements of the block may be quantized transformcoefficients. For example, the elements of the block may be quantizedtransform coefficients of a residual block (e.g., a residual blockresulting from intra-frame prediction or a residual block resulting frominter-frame prediction). For example, the elements of the block may bebased on a result of inter-frame prediction. For example, the block maybe a residual block resulting from inter-frame prediction. For example,the elements of the block may be based on a result of intra-frameprediction. For example, the block may be a residual block resultingfrom intra-frame prediction. In some implementations, the plurality ofgroups includes two groups (e.g., as shown in the examples of FIGS.15A-B, FIGS. 21A-B, FIG. 22A or FIG. 22B). For example, a first groupmay include elements of a first row of the block and elements of a firstcolumn of the block. In some implementations, the first group includeselements forming a triangle in a corner of the block, and wherein thetriangle includes elements of a first row of the block and elements of afirst column of the block (e.g., as shown in the examples of FIGS.21A-B, FIG. 22A or FIG. 22B). In some implementations, the first groupincludes elements of a first row of the block that are outside of thetriangle and elements of a first column of the block that are outside ofthe triangle (e.g., as shown in the examples of FIG. 22A or FIG. 22B).For example, a shape of the first group may be selected based on a sizeof the block (e.g., as described in relation to Table 2). For example, asecond group may include elements of a first row and a first column ofremaining elements of the block outside of the first group, and a thirdgroup may include all remaining elements of the block outside of theunion of the first group and the second group.

The process 1600 includes encoding 1620, using an entropy encoder usinga first scan order, elements of a first group from the plurality ofgroups of elements. The first scan order may be a default or initialscan order that a compatible entropy decoder is configured to use todecode elements of the first group for the block. For example, the firstscan order may be a zig-zag order (e.g., as shown in FIG. 15A). Forexample, the entropy encoder may employ entropy encoding techniques suchas, for example, variable length coding (VLC), context adaptive binaryarithmetic coding (CABAC), or context adaptive (multi-symbol) arithmeticcoding.

The process 1600 includes selecting 1622 a next group (e.g., a secondgroup) from the plurality of groups of elements of the block.

The process 1600 includes determining 1630, based on the elements of oneor more prior groups (e.g., the first group), a next scan order (e.g., asecond scan order) for the next group (e.g., the second group) from theplurality of groups of elements. In some implementations, the next scanorder may be determined 1630 by selecting from among options includinghorizontal, vertical, diagonal-right, diagonal-left, zig-zag, etc.(e.g., as illustrated in FIG. 15A and FIG. 21A). For example, the nextscan order may be determined 1630 based on a distribution of non-zeroelements (e.g., quantized transform coefficients of a residual block)within the first group. For example, the next scan order may bedetermined 1630 based on a distribution of non-zero elements within aunion of prior groups). For example, the process 1800 of FIG. 18A may beimplemented to determine 1630 the next scan order. For example, theprocess 1840 of FIG. 18B may be implemented to determine 1630 the nextscan order. In some implementations, the determined 1630 scan order mayincrease the probability that non-zero elements will be front loadedwithin the next group or remaining groups and that a sequence ofelements at the end of the resulting scan order for the block will bezeros that may be efficiently encoded, implicitly or explicitly, usingthe entropy encoder.

In some implementations, a process similar to the process 2500 of FIG.25A may be used to determine 1630 the next scan order (e.g., a secondscan order). For example, determining 1630 the second scan order mayinclude determining a first sum of magnitudes of elements in a portionof the first group below a main diagonal of the block and at or above ananti-diagonal of the block; determining a second sum of magnitudes ofelements in a portion of the first group above the main diagonal of theblock and at or above the anti-diagonal of the block; and determiningthe second scan order based on the first sum and the second sum. In someimplementations, a process similar to the process 2550 of FIG. 25B maybe used to determine 1630 the next scan order (e.g., a second scanorder). For example, determining 1630 the second scan order may includedetermining a first count of non-zero elements in a portion of the firstgroup below a main diagonal of the block and at or above ananti-diagonal of the block; determining a second count of non-zeroelements in a portion of the first group above the main diagonal of theblock and at or above the anti-diagonal of the block; and determiningthe second scan order based on the first count and the second count.

The process 1600 includes encoding 1640, using the entropy encoder usingthe next scan order (e.g., the second scan order), elements of the nextgroup (e.g., the second group) from the plurality of groups of elementsof the block. For example, the next scan order may be a horizontal scanorder, a vertical scan order, a diagonal-right scan order, adiagonal-left scan order, a zig-zag scan order, etc. (e.g., as shown inFIG. 15A and FIG. 21A). For example, the entropy encoder may employentropy encoding techniques such as, for example, variable length coding(VLC), context adaptive binary arithmetic coding (CABAC), or contextadaptive (multi-symbol) arithmetic coding. In some implementations, byadapting the scan order for the next group, the coding efficiency of theentropy encoder may be improved.

If (at 1645) the last group from the plurality of groups of elements ofthe block has not yet been encoded, then the next group is selected 1622and the processing of groups continues to encode remaining elements ofthe block.

When (at 1645) the last group from the plurality of groups of elementsof the block has been encoded, the encoded elements of the block areoutput 1650 to an encoded bitstream. For example, the encoded elementsmay be output from the entropy encoder 712 through the multiplexer 718to be included in the bitstream 720 that bears a video signal includingthe block. In some implementations, the bitstream may be stored (e.g.,in memory or on a disk) or transmitted (e.g., via network communicationlink). In some implementations (not shown), encoded elements may beoutput to an encoded bitstream as they become available.

In some implementations, the process 1600 adjusts the scan order for thenext stage on the fly based on information collected at a current stage.For example, let X denote an N×M block that has N>0 rows and M>0columns. The process 1600 may be implemented by specialized hardwareand/or software that performs operations corresponding to the followingpseudocode:

1. Partition X into K non-overlapping groups, denoted by X[1], X[2], . .. , X[K], respectively.

2. Use a default scan order (e.g., zigzag, diagonal, etc.) to encodeX[1].

3. Set k=2.

4. Determine the scan order to encode X[k] based on X[1], . . . ,X[k−1].

5. Encode X[k] by using the determined scan order.

6. Increase k by 1.

7. Repeat Steps 4-6 until k=K+1.

FIG. 17 is a flowchart of an example of a process 1700 for adapting scanorder to decode a block of video data. The process 1700 includespartitioning 1710 a block of video data into a plurality of groups ofelements; decoding 1720, using an entropy decoder, data from an encodedbitstream to obtain, using a first scan order, elements of a first groupfrom the plurality of groups of elements; selecting 1722 a next groupfrom the plurality of groups; determining 1730, based on the elements ofthe prior group(s), a next scan order for the next group; decoding 1740,using the entropy decoder, data from the encoded bitstream to obtain,using the next scan order, elements of the next group; and continuing(at 1745) to process any remaining groups from the plurality of groupsuntil all groups have been decoded 1740 and then outputting 1750 thedecoded elements of the block for processing to generate video. Forexample, the process 1700 may be implemented by the entropy decoder 756.For example, the process 1700 may be implemented by the receivingstation 106. For example, the process 1700 may be implemented by acomputing device, such as the computing device 200. For example, theprocess 1700 may be implemented by a software program includingmachine-readable instructions that can be stored in a memory such as thememory 204 or the secondary storage 214, and that can be executed by aprocessor, such as CPU 202, to cause a computing device to perform theprocess 1700. For example, the process 1700 may be implemented by adecoder such as the decoder 500 of FIG. 5. For example, the process 1700may be implemented by the entropy decoding stage 502 of the decoder 500of FIG. 5.

The process 1700 includes partitioning 1710 a block of video data into aplurality of groups of elements. The groups may be disjoint. The blockmay include a two-dimensional array of elements (e.g., a 4×4, 8×8,16×16, 32×32, or any other square or rectangular block size). A groupfrom the plurality of groups of elements may be continuous ordiscontinuous within the structure of the block. For example, theelements of the block may be pixel values (e.g., luminosity values). Forexample, the elements of the block may be quantized transformcoefficients. For example, the elements of the block may be quantizedtransform coefficients of a residual block (e.g., a residual blockresulting from intra-frame prediction or a residual block resulting frominter-frame prediction). For example, the elements of the block may bebased on a result of inter-frame prediction. For example, the block maybe a residual block resulting from inter-frame prediction. For example,the elements of the block may be based on a result of intra-frameprediction. For example, the block may be a residual block resultingfrom intra-frame prediction. In some implementations, the plurality ofgroups includes two groups (e.g., as shown in the examples of FIGS.15A-B, FIGS. 21A-B, FIG. 22A or FIG. 22B). For example, a first groupmay include elements of a first row of the block and elements of a firstcolumn of the block. In some implementations, the first group includeselements forming a triangle in a corner of the block, and wherein thetriangle includes elements of a first row of the block and elements of afirst column of the block (e.g., as shown in the examples of FIGS.21A-B, FIG. 22A or FIG. 22B). In some implementations, the first groupincludes elements of a first row of the block that are outside of thetriangle and elements of a first column of the block that are outside ofthe triangle (e.g., as shown in the examples of FIG. 22A or FIG. 22B).For example, a shape of the first group may be selected based on a sizeof the block (e.g., as described in relation to Table 2). For example, asecond group may include all remaining elements of the block outside ofthe first group. In some implementations, the plurality of groupsincludes more than two groups of elements. For example, a second groupmay include elements of a first row and a first column of remainingelements of the block outside of the first group, and a third group mayinclude all remaining elements of the block outside of the union of thefirst group and the second group.

The process 1700 includes decoding 1720, using an entropy decoder, datafrom an encoded bitstream to obtain, using a first scan order, elementsof a first group from the plurality of groups of elements. The firstscan order may be a default or initial scan order that a compatibleentropy encoder is configured to use to encode elements of the firstgroup for the block. For example, the first scan order may be a zig-zagorder (e.g., as shown in FIG. 15A). For example, the entropy decoder mayemploy entropy decoding techniques such as, for example, variable lengthcoding (VLC), context adaptive binary arithmetic coding (CABAC), orcontext adaptive (multi-symbol) arithmetic coding.

The process 1700 includes selecting 1722 a next group (e.g., a secondgroup) from the plurality of groups of elements of the block.

The process 1700 includes determining 1730, based on the elements of oneor more prior groups (e.g., the first group), a next scan order (e.g., asecond scan order) for the next group (e.g., the second group) from theplurality of groups of elements. In some implementations, the next scanorder may be determined 1730 by selecting from among options includinghorizontal, vertical, diagonal-right, diagonal-left, zig-zag, etc.(e.g., as illustrated in FIG. 15A and FIG. 21A). For example, the nextscan order may be determined 1730 based on a distribution of non-zeroelements (e.g., quantized transform coefficients of a residual block)within the first group. For example, the next scan order may bedetermined 1730 based on a distribution of non-zero elements within aunion of prior groups). For example, the process 1800 of FIG. 18A may beimplemented to determine 1730 the next scan order. For example, theprocess 1840 of FIG. 18B may be implemented to determine 1730 the nextscan order. In some implementations, the determined 1730 scan order mayincrease the probability that non-zero elements will be front loadedwithin the next group or remaining groups and that a sequence ofelements at the end of the resulting scan order for the block will bezeros that may be efficiently decoded, implicitly or explicitly, usingthe entropy decoder.

In some implementations, a process similar to the process 2500 of FIG.25A may be used to determine 1730 the next scan order (e.g., a secondscan order). For example, determining 1730 the second scan order mayinclude determining a first sum of magnitudes of elements in a portionof the first group below a main diagonal of the block and at or above ananti-diagonal of the block; determining a second sum of magnitudes ofelements in a portion of the first group above the main diagonal of theblock and at or above the anti-diagonal of the block; and determiningthe second scan order based on the first sum and the second sum. In someimplementations, a process similar to the process 2550 of FIG. 25B maybe used to determine 1730 the next scan order (e.g., a second scanorder). For example, determining 1730 the second scan order may includedetermining a first count of non-zero elements in a portion of the firstgroup below a main diagonal of the block and at or above ananti-diagonal of the block; determining a second count of non-zeroelements in a portion of the first group above the main diagonal of theblock and at or above the anti-diagonal of the block; and determiningthe second scan order based on the first count and the second count.

The process 1700 includes decoding 1740, using the entropy decoder, datafrom the encoded bitstream to obtain, using the next scan order (e.g.,the second scan order), elements of next group (e.g., the second group)from the plurality of groups of elements of the block. For example, thenext scan order may be a horizontal scan order, a vertical scan order, adiagonal-right scan order, a diagonal-left scan order, a zig-zag scanorder, etc. (e.g., as shown in FIG. 15A and FIG. 21A). For example, theentropy decoder may employ entropy decoding techniques such as, forexample, variable length coding (VLC), context adaptive binaryarithmetic coding (CABAC), or context adaptive (multi-symbol) arithmeticcoding. In some implementations, by adapting the scan order for the nextgroup, the coding efficiency of the entropy decoder may be improved.

If (at 1745) the last group from the plurality of groups of elements ofthe block has not yet been decoded, then the next group is selected 1722and the processing of groups continues to decode remaining elements ofthe block.

When (at 1745) the last group from the plurality of groups of elementsof the block has been decoded, the decoded elements of the block areoutput 1750 for processing to generate video. For example, the decodedelements may be output 1750 from the entropy decoder 756 through theinverse quantization/transform 760 and used to generate thereconstructed block 764 that forms part of a video. In someimplementations, the resulting video may be stored (e.g., in the memory204 or the secondary storage 214), transmitted (e.g., via a networkcommunication link), or displayed (e.g., in a user interface, such as onscreen or a projection). For example, the process 1700 may includedisplaying video that is generated based in part on the decoded elementsof the block (e.g., where the elements of the block are quantizedtransform coefficients of a residual block).

In some implementations, the process 1700 adjusts the scan order for thenext stage on the fly based on information collected at a current stage.For example, let X denote an N×M block that has N>0 rows and M>0columns. The process 1700 may be implemented by specialized hardwareand/or software that performs operations corresponding to the followingpseudocode:

1. Partition X into K non-overlapping groups, denoted by X[1], X[2], . .. , X[K], respectively.

2. Use a default scan order (e.g., zigzag, diagonal, etc.) to decodeX[1].

3. Set k=2.

4. Determine the scan order to decode X[k] based on X[1], . . . ,X[k−1].

5. Decode X[k] by using the determined scan order.

6. Increase k by 1.

7. Repeat Steps 4-6 until k=K+1.

FIG. 18A is a flowchart of an example of a process 1800 for determininga scan order for a next group of elements of a block of video data. Inthe example of process 1800, the prior group(s) (e.g., the first group)of elements, which are available in the encoder and decoder forconsideration in determining the scan order for the next group ofelements, include a first row of the elements in the block and a firstcolumn of elements in the block. The process 1800 includes determining1810 a first sum of magnitudes of elements in a portion of the first rowof the block; determining 1812 a second sum of magnitudes of elements ina portion of the first column of the block; if (at 1815) the first sumis zero and the second sum is positive, determining 1820 the next scanorder to be a vertical scan order; if (at 1825) the first sum ispositive and the second sum is zero, determining 1830 the next scanorder to be a horizontal scan order; otherwise, if (at 1825) the firstsum and the second sum are both positive or both zero, determining 1832the next scan order to be a default scan order. The same process 1800may be used for determining a next scan order in both an encoder and acompatible decoder. For example, the process 1800 may be implemented bythe entropy encoder 712 or the entropy decoder 756. For example, theprocess 1800 may be implemented by the transmitting station 102 or thereceiving station 106. For example, the process 1800 may be implementedby a computing device, such as the computing device 200. For example,the process 1800 may be implemented by a software program includingmachine-readable instructions that can be stored in a memory such as thememory 204 or the secondary storage 214, and that can be executed by aprocessor, such as CPU 202, to cause a computing device to perform theprocess 1800. For example, the process 1800 may be implemented by adecoder such as the decoder 500 of FIG. 5. For example, the process 1800may be implemented by an encoder such as the encoder 400 of FIG. 4. Forexample, the process 1800 may be implemented by the entropy encodingstage 408 of the encoder 400 of FIG. 4. For example, the process 1800may be implemented by the entropy decoding stage 502 of the decoder 500of FIG. 5.

The process 1800 includes determining 1810 a first sum of magnitudes ofelements in a portion of the first row of the block. For example, theportion of the first row may be a right half of the first row. In someimplementations, the portion of the first row may be the whole firstrow. In some implementations, the elements may be constrained to takeinteger values (e.g., as a result of quantization). For example, themagnitude of an element may be the absolute value of the element. Insome implementations, the magnitude of an element may be represented asthe square of the value of the element or another quantity that variesmonotonically with the absolute value of the element. For example, thefirst sum may be determined 1810 as:

SR=|r[ceil(M/2)]|+|r[ceil(M/2)+1]|+ . . . +|r[M−1]|  (9)

where SR is the first sum; M is the number of columns in the block(e.g., an N×M block); r[i] is the ith element of the first row of theblock for i=0 to M−1; and ceil( ) denotes the ceiling function, i.e.,for any real number a, ceil(a) returns the smallest integer that isgreater than or equal to a. M may be greater than or equal to two. Forexample, the elements of the block may be quantized transformcoefficients of a residual block (e.g., a residual block resulting fromintra-frame prediction or a residual block resulting from inter-frameprediction).

The process 1800 includes determining 1812 a second sum of magnitudes ofelements in a portion of the first column of the block. For example, theportion of the first column may be a bottom half of the first column. Insome implementations, the portion of the first row may be the wholefirst column. In some implementations, the elements may be constrainedto take integer values (e.g., as a result of quantization). For example,the magnitude of an element may be the absolute value of the element. Insome implementations, the magnitude of an element may be represented asthe square of the value of the element or another quantity that variesmonotonically with the absolute value of the element. For example, thesecond sum may be determined 1812 as:

SC=|c[ceil(N/2)]|+|c[ceil(N/2)+1]|+ . . . |c[N−1]|  (10)

where SC is the second sum; N is the number of rows in the block (e.g.,an N×M block); and c[i] is the ith element of the first column of theblock for i=0 to N−1. N may be greater than or equal to two.

The process 1800 may include, responsive to the first sum (e.g., SR ofequation 9) being zero and the second sum (e.g., SC of equation 10)being positive (at 1815), determining 1820 the next scan order (e.g., asecond scan order) to be a vertical scan order (e.g., as illustrated bythe scan order 1520 of FIG. 15A).

The process 1800 may include, responsive to the first sum (e.g., SR ofequation 9) being positive and the second sum (e.g., SC of equation 10)being zero (at 1825), determining 1830 the next scan order (e.g., thesecond scan order) to be a horizontal scan order (e.g., as illustratedby the scan order 1510 of FIG. 15A).

Otherwise, the process 1800 may include, responsive to the first sum(e.g., SR of equation 9) and the second sum (e.g., SC of equation 10)both being positive or both being zero, determining 1832 the next scanorder (e.g., the second scan order) to be a default scan order (e.g.,zig-zag, diagonal, etc.).

In some embodiments (not shown), SR==0 at 1815 may be replaced bySR<=fifth threshold and SC>0 may be replaced by SC>=sixth threshold.Similarly, SR>0 at 1825 may be replaced by SR>=sixth threshold and SC==0at 1825 may be replaced by SC<=fifth threshold.

FIG. 18B is a flowchart of an example of a process 1840 for determininga scan order for a next group of elements of a block of video data. Inthe example of process 1840, the prior group(s) (e.g., the first group)of elements, which are available in the encoder and decoder forconsideration in determining the scan order for the next group ofelements, include a first row of the elements in the block and a firstcolumn of elements in the block. The process 1840 includes determining1850 a first count of non-zero elements in a portion of the first row ofthe block; determining 1852 a second count of non-zero elements in aportion of the first column of the block; if (at 1855) the first countis zero and the second count is positive, determining 1860 the next scanorder to be a vertical scan order; if (at 1865) the first count ispositive and the second count is zero, determining 1870 the next scanorder to be a horizontal scan order; otherwise, if (at 1865) the firstcount and the second count are both positive or both zero, determining1872 the next scan order to be a default scan order. The same process1840 may be used for determining a next scan order in both an encoderand a compatible decoder. For example, the process 1840 may beimplemented by the entropy encoder 712 or the entropy decoder 756. Forexample, the process 1840 may be implemented by the transmitting station102 or the receiving station 106. For example, the process 1840 may beimplemented by a computing device, such as the computing device 200. Forexample, the process 1840 may be implemented by a software programincluding machine-readable instructions that can be stored in a memorysuch as the memory 204 or the secondary storage 214, and that can beexecuted by a processor, such as CPU 202, to cause a computing device toperform the process 1840. For example, the process 1840 may beimplemented by a decoder such as the decoder 500 of FIG. 5. For example,the process 1840 may be implemented by an encoder such as the encoder400 of FIG. 4. For example, the process 1840 may be implemented by theentropy encoding stage 408 of the encoder 400 of FIG. 4. For example,the process 1840 may be implemented by the entropy decoding stage 502 ofthe decoder 500 of FIG. 5.

The process 1840 includes determining 1850 a first count of non-zeroelements in a portion of the first row of the block. For example, theportion of the first row may be a right half of the first row. In someimplementations, the portion of the first row may be the whole firstrow. In some implementations, the first count may be determined 1850based on a non-zero map (e.g., similar to the non-zero map 606) foravailable group(s) of the block. For example, the first count may bedetermined 1850 as a sum of the binary values from a non-zero mapcorresponding to the portion of the first row of the block. For example,the first count may be determined 1850 as:

CR=nz(r[ceil(M/2)])+nz(r[ceil(M/2)+1])+ . . . nz(r[M−1])  (11)

where CR is the first count; M is the number of columns in the block(e.g., an N×M block); r[i] is the ith element of the first row of theblock for i=0 to M−1; nz( ) denotes a non-zero function that returns oneif the argument is non-zero and zero if the argument is zero; and ceil() denotes the ceiling function, i.e., for any real number a, ceil(a)returns the smallest integer that is greater than or equal to a. M maybe greater than or equal to two. For example, the elements of the blockmay be quantized transform coefficients of a residual block (e.g., aresidual block resulting from intra-frame prediction or a residual blockresulting from inter-frame prediction).

The process 1840 includes determining 1852 a second count of non-zeroelements in a portion of the first column of the block. For example, theportion of the first column may be a bottom half of the first column. Insome implementations, the portion of the first column may be the wholefirst column. In some implementations, the second count may bedetermined 1852 based on a non-zero map (e.g., similar to the non-zeromap 606) for available group(s) of the block. For example, the secondcount may be determined 1850 as a sum of the binary values from anon-zero map corresponding to the portion of the first column of theblock. For example, the second count may be determined 1852 as:

CC=nz(c[ceil(N/2)])+nz(c[ceil(N/2)+1])+ . . . nz(c[N−1])  (12)

where CC is the second count; N is the number of rows in the block(e.g., an N×M block); and c[i] is the ith element of the first column ofthe block for i=0 to N−1. N may be greater than or equal to two. Forexample, the elements of the block may be quantized transformcoefficients of a residual block (e.g., a residual block resulting fromintra-frame prediction or a residual block resulting from inter-frameprediction).

The process 1840 may include, responsive to the first count (e.g., CR ofequation 11) being zero and the second count (e.g., CC of equation 12)being positive (at 1855), determining 1860 the next scan order (e.g., asecond scan order) to be a vertical scan order (e.g., as illustrated bythe scan order 1520 of FIG. 15A).

The process 1840 may include, responsive to the first count (e.g., CR ofequation 11) being positive and the second count (e.g., CC of equation12) being zero (at 1865), determining 1870 the next scan order (e.g.,the second scan order) to be a horizontal scan order (e.g., asillustrated by the scan order 1510 of FIG. 15A).

Otherwise, the process 1840 may include, responsive to the first count(e.g., CR of equation 11) and the second count (e.g., CC of equation 12)both being positive or both being zero, determining 1872 the next scanorder (e.g., the second scan order) to be a default scan order (e.g.,zig-zag, diagonal, etc.).

In some implementations, CR==0 at 1855 may be replaced by CR<=sevenththreshold and CC>0 may be replaced by CC>=eighth threshold. Similarly,CR>0 at 1865 may be replaced by CR>=eighth threshold and CC==0 at 1865may be replaced by CC<=seventh threshold.

In some implementations, CR and CC may be further used to determine thedirection of the default scan order. For example, if the default scanorder is the zig-zag scan order (downward first), then a transposedzig-zag scan order (to the right first) is to be used if CR is greaterthan CC; otherwise the (downward first) zig-zag scan order is to beused. If the default scan order is the 45-degree diagonal scan order(upward to the right), then the 225-degree diagonal scan order (downwardto the left) may be used if CR is greater than CC; otherwise the45-degree diagonal scan order may be used. SR and SC of equation 9 andequation 10 above may be used to determine the direction of the defaultscan order in a similar fashion.

In some implementations, an encoder may manipulate CR and CC so that thedesired scan order is chosen. For example, if the horizontal scan orderis desired, the encoder can select quantized coefficients in the firstrow and the first column such that CR is non-zero and CC is zero (orthey satisfy appropriate threshold constraints). The selection ofquantized coefficients can be based on rate distortion cost. Similarly,the encoder may manipulate SR and SC to make sure the desired scan orderis chosen.

The process 1600 may impact context derivation in coding quantizedtransform coefficients. For example, depending upon the scan orderselected, the available neighboring coefficients available for derivingcontexts to code the current coefficient may be different. For examplesome entropy coding schemes may use two previously coded neighbors toderive a context for coding (encoding and decoding) a currentcoefficient represented by a token. Suppose that the first group in theprocess 1600 consists of the first row and the first column of thecurrent block. Then the block positions of the two neighbors used forcontext derivation in coding a token at block position [r, c] may begiven in the table below.

TABLE 1 Neighbors for context derivation in coefficient coding NeighborA Neighbor B [0, 0] N/A N/A [1, 0] [0, 0] N/A [0, 1] [0, 0] [1, 0] [r,0], r > 1 [r-1, 0] [r-2, 0] [0, c], c > 1 [0, c-1] [0, c-2] [r, c], r >0, c > 0 [r-1, c] [r, c-1]

In some implementations, contexts used in coding coefficients in a groupother than the first group may depend upon the scan order selected forthat group. For example, one context may be used for coding thecoefficient at position (r, c), where r>0 and c>0, in the second groupof FIG. 15B if the selected scan order for the second group is thehorizontal or the vertical scan order and a different context may beused for coding the coefficient at position (r, c) if the selected scanorder for the second group is the zig-zag scan order.

The process 1600 may be used in tandem with processes (e.g., the process900) for encoding an intra-prediction mode for a block using contextdetermined based on elements of the block. In some implementations, sucha combination of processes (e.g., of the process 1600 with the process900) may be used to more fully leverage a correlation betweenintra-prediction modes and quantized transform coefficients in entropycoding.

FIG. 19 is a flowchart of an example of a process 1900 for adapting scanorder to encode a block of video data and encoding an intra-predictionmode for the block using a context selected based on data in the block.The process 1900 includes partitioning 1910 a block of video data into aplurality of groups of elements; encoding 1920, using an entropy encoderusing a first scan order, elements of a first group from the pluralityof groups of elements; selecting 1922 a next group from the plurality ofgroups; determining 1930, based on the elements of the prior group(s), anext scan order for the next group; encoding 1940, using the entropyencoder, using the next scan order, elements of the next group; andcontinuing (at 1945) to process any remaining groups from the pluralityof groups until all groups have been encoded 1940; determining 1950,based on the elements of the block, a category (e.g., horizontal,vertical, or diagonal) for the block; determining 1952 a context basedon the category; encoding 1954, using an entropy decoder with thecontext, an intra-prediction mode for the block; and outputting 1960 theencoded elements of the block and the encoded intra-prediction mode forthe block to a bitstream. For example, the process 1900 may beimplemented by the entropy encoder 712. For example, the process 1900may be implemented by the transmitting station 102. For example, theprocess 1900 may be implemented by a computing device, such as thecomputing device 200. For example, the process 1900 may be implementedby a software program including machine-readable instructions that canbe stored in a memory such as the memory 204 or the secondary storage214, and that can be executed by a processor, such as CPU 202, to causea computing device to perform the process 1900. For example, the process1900 may be implemented by an encoder such as the encoder 400 of FIG. 4.For example, the process 1900 may be implemented by the entropy encodingstage 408 of the encoder 400 of FIG. 4.

The process 1900 includes partitioning 1910 a block of video data into aplurality of groups of elements. The groups may be disjoint. The blockmay include a two-dimensional array of elements (e.g., a 4×4, 8×8,16×16, 32×32, or any other square or rectangular block size). A groupfrom the plurality of groups of elements may be continuous ordiscontinuous within the structure of the block. For example, theelements of the block may be pixel values (e.g., luminosity values). Forexample, the elements of the block may be quantized transformcoefficients. For example, the elements of the block may be quantizedtransform coefficients of a residual block (e.g., a residual blockresulting from intra-frame prediction or a residual block resulting frominter-frame prediction). For example, the elements of the block may bebased on a result of inter-frame prediction. For example, the block maybe a residual block resulting from inter-frame prediction. For example,the elements of the block may be based on a result of intra-frameprediction. For example, the block may be a residual block resultingfrom intra-frame prediction. In some implementations, the plurality ofgroups includes two groups (e.g., as shown in the example of FIG. 15A).For example, a first group may include elements of a first row of theblock and elements of a first column of the block. For example, a secondgroup may include all remaining elements of the block outside of thefirst group. In some implementations, the plurality of groups includesmore than two groups of elements. For example, a second group mayinclude elements of a first row and a first column of remaining elementsof the block outside of the first group, and a third group may includeall remaining elements of the block outside of the union of the firstgroup and the second group.

The process 1900 includes encoding 1920, using an entropy encoder usinga first scan order, elements (e.g., quantized transform coefficients ofan intra-prediction residual block) of a first group from the pluralityof groups of elements. The first scan order may be a default or initialscan order that a compatible entropy decoder is configured to use todecode elements of the first group for the block. For example, the firstscan order may be a zig-zag order (e.g., as shown in FIG. 15A). Forexample, the entropy encoder may employ entropy encoding techniques suchas, for example, variable length coding (VLC), context adaptive binaryarithmetic coding (CABAC), or context adaptive (multi-symbol) arithmeticcoding.

The process 1900 includes selecting 1922 a next group (e.g., a secondgroup) from the plurality of groups of elements of the block. Forexample, the next group may be selected 1922 by incrementing a groupindex.

The process 1900 includes determining 1930, based on the elements of oneor more prior groups (e.g., the first group), a next scan order (e.g., asecond scan order) for the next group (e.g., the second group) from theplurality of groups of elements. In some implementations, the next scanorder may be determined 1930 by selecting from among options includinghorizontal, vertical, diagonal, zig-zag, etc. (e.g., as illustrated inFIG. 15A). For example, the next scan order may be determined 1930 basedon a distribution of non-zero elements (e.g., quantized transformcoefficients of an intra-prediction residual block) within the firstgroup. For example, the next scan order may be determined 1930 based ona distribution of non-zero elements within a union of prior groups). Forexample, the process 1800 of FIG. 18A may be implemented to determine1930 the next scan order. For example, the process 1840 of FIG. 18B maybe implemented to determine 1930 the next scan order. In someimplementations, the determined 1930 scan order may increase theprobability that non-zero elements will be front loaded within the nextgroup or remaining groups and that a sequence of elements at the end ofthe resulting scan order for the block will be zeros that may beefficiently encoded, implicitly or explicitly, using the entropyencoder.

The process 1900 includes encoding 1940, using the entropy encoder usingthe next scan order (e.g., the second scan order), elements of the nextgroup (e.g., the second group) from the plurality of groups of elementsof the block. For example, the next scan order may be a horizontal scanorder, a vertical scan order, a zig-zag scan order, etc. (e.g., as shownin FIG. 15A). For example, the entropy encoder may employ entropyencoding techniques such as, for example, variable length coding (VLC),context adaptive binary arithmetic coding (CABAC), or context adaptive(multi-symbol) arithmetic coding. In some implementations, by adaptingthe scan order for the next group, the coding efficiency of the entropyencoder may be improved.

If (at 1945) the last group from the plurality of groups of elements ofthe block has not yet been encoded, then the next group is selected 1922and the processing of groups continues to encode 1940 remaining elementsof the block.

When (at 1945) the last group from the plurality of groups of elementsof the block has been encoded, a category for the block is determined1950 based on the elements (e.g., quantized transform coefficients of anintra-prediction residual block) of the block. For example, the categorymay be determined as one of horizontal, vertical, and other (i.e., nothorizontal or vertical, e.g., diagonal). The category may indicate adirectional pattern in a distribution of non-zero elements within theblock, which may be related to an intra-prediction mode that was used togenerate the block. In some implementations, the category may bedetermined 1950 based on a first count of non-zero elements in a firstportion of the block (e.g., a right half of the block) and based on asecond count of non-zero elements in a second portion of the block(e.g., a bottom half of the block). For example, if the first count iszero and the second count is positive, the category may be determined1950 to be vertical. For example, if the first count is positive and thesecond count is zero, the category may be determined 1950 to behorizontal. For example, if the first count and the second count areboth zero or both positive, the category may be determined 1950 to bediagonal. In some implementations, the category may be determined 1950based on elements in the first group of elements of the block. Forexample, the category may be determined 1950 to be vertical when CR ofequation 11 is zero and CC of equation 12 is positive. For example, thecategory may be determined 1950 to be horizontal when CR of equation 11is positive and CC of equation 12 is zero. For example, the category maybe determined 1950 to be diagonal when CR of equation 11 and CC ofequation 12 are both zero or both positive. In some implementations, thecategory (t) may be determined using the algorithm (2) described inrelation to FIG. 9. In some implementations, the category (t) may bedetermined using the algorithm (6) described in relation to FIG. 9. Insome implementations, the category (t) may be determined using thealgorithm (7) described in relation to FIG. 9. In some implementations,the category (t) may be determined using the algorithm (8) described inrelation to FIG. 9.

The process 1900 includes determining 1952 a context based on thecategory. Because patterns in the distribution of non-zero elements ofthe block may be correlated with an intra-prediction mode that was usedto generate the block, the category may be used to select a more usefulcontext for the intra-prediction mode, which may improve codingefficiency for encoding the intra-prediction mode. For example, thecontext may be determined 1952 as described with respect to operation904 of FIG. 9. For example, the context may be determined 1952 using theequation (3) described in relation to FIG. 9. For example, the contextmay be determined 1952 using the equation (4) described in relation toFIG. 9. For example, the context may be determined 1952 using theequation (5) described in relation to FIG. 9.

The process 1900 includes encoding 1954, using an entropy decoder withthe context, an intra-prediction mode for the block. For example, theintra-prediction mode may be encoded 1954 as described in relation tooperation 906 of FIG. 9.

The process 1900 includes outputting 1960 the encoded elements of theblock and the encoded intra-prediction mode for the block to an encodedbitstream. For example, the encoded elements may be output 1960 from theentropy encoder 712 through the multiplexer 718 to be included in thebitstream 720 that bears a video signal including the block. Forexample, the encoded intra-prediction mode may be output 1960 from theentropy encoder 716 through the multiplexer 718 to be included in thebitstream 720 that bears a video signal including the block. In someimplementations, the bitstream may be stored (e.g., in memory or on adisk) or transmitted (e.g., via network communication link). In someimplementations (not shown), encoded elements may be output to anencoded bitstream as they become available.

In some implementations, the process 1900 may be implemented byspecialized hardware and/or software that performs operationscorresponding to the following pseudocode (which uses the definitionsprovided in relation to equation 11 and equation 12 above):

1. Determine an intra-prediction mode m to generate prediction P for thecurrent block X.

2. Compute the residual block E=X−P, and obtain quantized coefficientsby performing transform (if applicable) and quantization.

3. Use a default scan order (e.g. zigzag, diagonal, etc.) to encoder[0], . . . , r[N−1] and c[0], . . . , c[N−1]. (An example of such ascan order is shown in FIG. 15A.)

-   -   a. if CC>=1 and CR==0, set t=1, and select the vertical scan        order.    -   b. if CC==0 and CR>=1, set t=2, and select the horizontal scan        order.    -   c. otherwise, set t=0, and select the default scan order (e.g.,        zigzag, diagonal, etc.).

4. Encode the intra-prediction mode m by using the category t.

5. Encode the remaining coefficients of the block by using the scanorder selected in Step 3.

The process 1700 may be used in tandem with techniques (e.g., theprocess 1100) for decoding an intra-prediction mode for a block usingcontext determined based on elements of the block. In someimplementations, such a combination of techniques (e.g., of the process1700 with the process 1100) may be used to more fully leverage acorrelation between intra-prediction modes and quantized transformcoefficients in entropy coding.

FIG. 20 is a flowchart of an example of a process 2000 for adapting scanorder to decode a block of video data and decoding an intra-predictionmode for the block using a context selected based on data in the block.The process 2000 includes partitioning 2010 a block of video data into aplurality of groups of elements; decoding 2020, using an entropydecoder, data from an encoded bitstream to obtain, using a first scanorder, elements of a first group from the plurality of groups ofelements; selecting 2022 a next group from the plurality of groups;determining 2030, based on the elements of the prior group(s), a nextscan order for the next group; decoding 2040, using the entropy decoder,data from the encoded bitstream to obtain, using the next scan order,elements of the next group; and continuing (at 2045) to process anyremaining groups from the plurality of groups until all groups ofelements of the block have been decoded 2040; determining 2050, based onthe decoded elements of the block, a category (e.g., horizontal,vertical, or diagonal) for the block; determining 2052 a context basedon the category; decoding 2054, using an entropy decoder with thecontext, data from the encoded bitstream to obtain an intra-predictionmode for the block; and outputting 2060 the decoded elements of theblock and the decoded intra-prediction mode for processing to generatevideo. For example, the process 2000 may be implemented by the entropydecoder 756. For example, the process 2000 may be implemented by thereceiving station 106. For example, the process 2000 may be implementedby a computing device, such as the computing device 200. For example,the process 2000 may be implemented by a software program includingmachine-readable instructions that can be stored in a memory such as thememory 204 or the secondary storage 214, and that can be executed by aprocessor, such as CPU 202, to cause a computing device to perform theprocess 2000. For example, the process 2000 may be implemented by adecoder such as the decoder 500 of FIG. 5. For example, the process 2000may be implemented by the entropy decoding stage 502 of the decoder 500of FIG. 5.

The process 2000 includes partitioning 2010 a block of video data into aplurality of groups of elements. The groups may be disjoint. The blockmay include a two-dimensional array of elements (e.g., a 4×4, 8×8,16×16, 32×32, or any other square or rectangular block size). A groupfrom the plurality of groups of elements may be continuous ordiscontinuous within the structure of the block. For example, theelements of the block may be pixel values (e.g., luminosity values). Forexample, the elements of the block may be quantized transformcoefficients. For example, the elements of the block may be quantizedtransform coefficients of a residual block (e.g., a residual blockresulting from intra-frame prediction or a residual block resulting frominter-frame prediction). For example, the elements of the block may bebased on a result of inter-frame prediction. For example, the block maybe a residual block resulting from inter-frame prediction. For example,the elements of the block may be based on a result of intra-frameprediction. For example, the block may be a residual block resultingfrom intra-frame prediction. In some implementations, the plurality ofgroups includes two groups (e.g., as shown in the example of FIG. 15A).For example, a first group may include elements of a first row of theblock and elements of a first column of the block. For example, a secondgroup may include all remaining elements of the block outside of thefirst group. In some implementations, the plurality of groups includesmore than two groups of elements. For example, a second group mayinclude elements of a first row and a first column of remaining elementsof the block outside of the first group, and a third group may includeall remaining elements of the block outside of the union of the firstgroup and the second group.

The process 2000 includes decoding 2020, using an entropy decoder, datafrom an encoded bitstream to obtain, using a first scan order, elementsof a first group from the plurality of groups of elements. The firstscan order may be a default or initial scan order that a compatibleentropy encoder is configured to use to encode elements of the firstgroup for the block. For example, the first scan order may be a zig-zagorder (e.g., as shown in FIG. 15A). For example, the entropy decoder mayemploy entropy decoding techniques such as, for example, variable lengthcoding (VLC), context adaptive binary arithmetic coding (CABAC), orcontext adaptive (multi-symbol) arithmetic coding.

The process 2000 includes selecting 2022 a next group (e.g., a secondgroup) from the plurality of groups of elements of the block. Forexample, the next group may be selected 2022 by incrementing a groupindex.

The process 2000 includes determining 2030, based on the elements of oneor more prior groups (e.g., the first group), a next scan order (e.g., asecond scan order) for the next group (e.g., the second group) from theplurality of groups of elements. In some implementations, the next scanorder may be determined 2030 by selecting from among options includinghorizontal, vertical, diagonal, zig-zag, etc. (e.g., as illustrated inFIG. 15A). For example, the next scan order may be determined 2030 basedon a distribution of non-zero elements (e.g., quantized transformcoefficients) within the first group. For example, the next scan ordermay be determined 2030 based on a distribution of non-zero elementswithin a union of prior groups). For example, the process 1800 of FIG.18A may be implemented to determine 2030 the next scan order. Forexample, the process 1840 of FIG. 18B may be implemented to determine2030 the next scan order. In some implementations, the determined 2030scan order may increase the probability that non-zero elements will befront loaded within the next group or remaining groups and that asequence of elements at the end of the resulting scan order for theblock will be zeros that may be efficiently decoded, implicitly orexplicitly, using the entropy decoder.

The process 2000 includes decoding 2040, using the entropy decoder, datafrom the encoded bitstream to obtain, using the next scan order (e.g.,the second scan order), elements of next group (e.g., the second group)from the plurality of groups of elements of the block. For example, thenext scan order may be a horizontal scan order, a vertical scan order, azig-zag scan order, etc. (e.g., as shown in FIG. 15A). For example, theentropy decoder may employ entropy decoding techniques such as, forexample, variable length coding (VLC), context adaptive binaryarithmetic coding (CABAC), or context adaptive (multi-symbol) arithmeticcoding. In some implementations, by adapting the scan order for the nextgroup, the coding efficiency of the entropy decoder may be improved.

If (at 2045) the last group from the plurality of groups of elements ofthe block has not yet been decoded, then the next group is selected 2022and the processing of groups continues to decode 2040 remaining elementsof the block.

When (at 2045) the last group from the plurality of groups of elementsof the block has been decoded, a category for the block is determined2050 based on the decoded elements (e.g., quantized transformcoefficients of an intra-prediction residual block) of the block. Forexample, the category may be determined as one of horizontal, vertical,and other (i.e., not horizontal or vertical, e.g., diagonal). Thecategory may indicate a directional pattern in a distribution ofnon-zero elements within the block, which may be related to anintra-prediction mode that was used to generate the block. In someimplementations, the category may be determined 2050 based on a firstcount of non-zero elements in a first portion of the block (e.g., aright half of the block) and based on a second count of non-zeroelements in a second portion of the block (e.g., a bottom half of theblock). For example, if the first count is zero and the second count ispositive, the category may be determined 2050 to be vertical. Forexample, if the first count is positive and the second count is zero,the category may be determined 2050 to be horizontal. For example, ifthe first count and the second count are both zero or both positive, thecategory may be determined 2050 to be diagonal. In some implementations,the category may be determined 2050 based on elements in the first groupof elements of the block. For example, the category may be determined2050 to be vertical when CR of equation 11 is zero and CC of equation 12is positive. For example, the category may be determined 2050 to behorizontal when CR of equation 11 is positive and CC of equation 12 iszero. For example, the category may be determined 2050 to be diagonalwhen CR of equation 11 and CC of equation 12 are both zero or bothpositive. In some implementations, the category (t) may be determinedusing the algorithm (2) described in relation to FIG. 9. In someimplementations, the category (t) may be determined using the algorithm(6) described in relation to FIG. 9. In some implementations, thecategory (t) may be determined using the algorithm (7) described inrelation to FIG. 9. In some implementations, the category (t) may bedetermined using the algorithm (8) described in relation to FIG. 9.

The process 2000 includes determining 2052 a context based on thecategory. Because patterns in the distribution of non-zero elements ofthe block may be correlated with an intra-prediction mode that was usedto generate the block, the category may be used to select a more usefulcontext for the intra-prediction mode, which may improve codingefficiency for decoding the intra-prediction mode. For example, thecontext may be determined 2052 as described with respect to operation904 of FIG. 9. For example, the context may be determined 2052 using theequation (3) described in relation to FIG. 9. For example, the contextmay be determined 2052 using the equation (4) described in relation toFIG. 9. For example, the context may be determined 2052 using theequation (5) described in relation to FIG. 9.

The process 2000 includes decoding 2054, using an entropy decoder withthe context, data from the encoded bitstream to obtain anintra-prediction mode for the block. For example, the intra-predictionmode may be decoded 2054 as described in relation to operation 1106 ofFIG. 11.

The process 2000 includes outputting 2060 the decoded elements of theblock and the decoded intra-prediction mode for the block for processingto generate video. For example, the decoded elements may be output 2060from the entropy decoder 756 through the inverse quantization/transform760 and used to generate the reconstructed block 764 that forms part ofa video. For example, the decoded intra-prediction mode may be output2060 from the entropy decoder 754 to the intra prediction 768 and usedto generate the reconstructed block 764 that forms part of a video. Insome implementations, the resulting video may be stored (e.g., in memoryor on a disk), transmitted (e.g., via network communication link), ordisplayed (e.g., in a user interface, such as on screen or aprojection). For example, the process 2000 may include displaying videothat is generated based in part on the decoded elements of the block(e.g., where the elements of the block are quantized transformcoefficients of a residual block) and based in part on the decodedintra-prediction mode.

In some implementations, the process 2000 may be implemented byspecialized hardware and/or software that performs operationscorresponding to the following pseudocode (which uses the definitionsprovided in relation to equation 11 and equation 12 above):

1. Use a default scan order (e.g. zigzag, diagonal, etc.) to decoder[0], . . . , r[N−1] and c[0], . . . , c[N−1]. (An example of such ascan order is shown in FIG. 15A.)

-   -   a. if CC>=1 and CR==0, set t=1, and select the vertical scan        order.    -   b. if CC==0 and CR>=1, set t=2, and select the horizontal scan        order.    -   c. otherwise, set t=0, and select the default scan order (e.g.,        zigzag, diagonal, etc.).

2. Decode an intra-prediction mode m by using t.

3. Decode the remaining coefficients of the block by using the scanorder selected in Step 1.

4. Use the intra-prediction mode m to generate prediction P.

5. From the decoded coefficients, reconstruct a residual block E byperforming inverse quantization and inverse transform (if applicable).

6. Reconstruct the current image block {circumflex over (X)}=P+Ê.

In some implementations, a category for a block, determined based onelements of the block, may be used to encode and decode anintra-prediction mode m in a variety of ways, such as, deriving thecontext used to encode and decode the intra-prediction mode m, and/orderiving a predictor for the intra-prediction mode m (e.g., as describedwith respect to the intra-prediction mode predictor p of FIG. 9). Forexample, an intra-prediction mode m may be differentially encoded anddecoded using a prediction of m that is determined based on a categoryfor the block.

The adaptive scan order scheme of FIGS. 15A-B may be modified using asmaller first group of elements with a different shape, which mayinclude elements that are less likely to be zero (e.g., the element inthe second row and second column may be likely to be non-zero where itis a low frequency transform coefficient). Adjusting a first group to besmaller and more likely to include all non-zero values of the block mayimprove coding efficiency. FIG. 21A is a diagram of an example of a setof scan orders 2100 for a block that are adapted based on data of afirst group of elements of the block. The numbers shown in the cells ofFIG. 21A are scan order sequence numbers for respective elements of theblock at the corresponding locations within the block. The example setof scan orders 2100 includes four scan orders: alternating diagonal,horizontal scan order 2110; alternating diagonal, vertical scan order2120; alternating diagonal, diagonal-right scan order 2130; andalternating diagonal, diagonal-left scan order 2140. In the example ofFIG. 21A, the block to be coded is partitioned into two groups ofelements: a first group that is coded (e.g., encoded or decoded) firstusing an alternating diagonal scan order reflected in the scan ordersequence numbers 0-5 in the shaded cells of the diagram of FIG. 21A; anda second group that is coded (e.g., encoded or decoded) next using ascan order that is selected or adapted based on the elements from thefirst group. For example, a horizontal scan order may be selected forthe second group, resulting in the alternating diagonal, horizontal scanorder 2110 for the block. For example, a vertical scan order may beselected for the second group, resulting in the alternating diagonal,vertical scan order 2120 for the block. For example, a diagonal-rightscan order may be selected for the second group, resulting in thealternating diagonal, diagonal-right scan order 2130 for the block. Forexample, a diagonal-left scan order may be selected for the secondgroup, resulting in the alternating diagonal, diagonal-left scan order2140 for the block. In the example of FIG. 21A, the first group includeselements forming a triangle in a corner of the block, and wherein thetriangle includes elements of a first row of the block and elements of afirst column of the block. In the example of FIG. 21A, the second groupincludes all remaining elements of the block outside of the first group.For example, the elements of the block may be quantized transformcoefficients. For example, the elements of the block may be quantizedtransform coefficients of a residual block (e.g., a residual blockresulting from intra-frame prediction or a residual block resulting frominter-frame prediction).

FIG. 21B is a diagram of an example of a set of scan orders 2150 for ablock that are adapted based on magnitudes for a first group of elementsof the block. The numbers shown in the cells of FIG. 21B are magnitudesof values for respective elements of the block at the correspondinglocations within the block. The example set of scan orders 2150 includesfour scan orders: alternating diagonal, horizontal scan order 2160;alternating diagonal, vertical scan order 2170; alternating diagonal,diagonal-right scan order 2180; and alternating diagonal, diagonal-leftscan order 2190. In the example of FIG. 21B, the block to be coded ispartitioned into two groups of elements: a first group that is coded(e.g., encoded or decoded) first using an alternating diagonal scanorder; and a second group that is coded (e.g., encoded or decoded) nextusing a scan order that is selected or adapted based on a distribution(e.g., sums of magnitudes in certain portions of the first group) ofnon-zero elements from the first group. In the example of FIG. 21B, thefirst group includes elements forming a triangle in a corner of theblock, and wherein the triangle includes elements of a first row of theblock and elements of a first column of the block. In the example ofFIG. 21B, the second group includes all remaining elements of the blockoutside of the first group. For example, a horizontal scan order may beselected for the second group, resulting in the alternating diagonal,horizontal scan order 2160 for the block, where a sum of magnitudes ofelements in a portion of the first row is positive and a sum ofmagnitudes of elements in a portion of the first column is zero. Forexample, a vertical scan order may be selected for the second group,resulting in the alternating diagonal, vertical scan order 2170 for theblock, where a sum of magnitudes of elements in a portion of the firstrow is zero. For example, a diagonal-left scan order may be selected forthe second group, resulting in the alternating diagonal, diagonal-leftscan order 2190 for the block, where a sum of magnitudes of elements ina portion of the first row is greater than a sum of magnitudes ofelements in a portion of the first column and both sums are positive.For example, a diagonal-right scan order may be selected for the secondgroup, resulting in the alternating diagonal, diagonal-right scan order2180 for the block otherwise (e.g., where both sums are positive and therow sum is less than or equal to the column sum). For example, theelements of the block may be quantized transform coefficients. Forexample, the elements of the block may be quantized transformcoefficients of a residual block (e.g., a residual block resulting fromintra-frame prediction or a residual block resulting from inter-frameprediction).

In the examples shown in FIGS. 21A-B, after scanning the first group ofelements (shown in shaded cells), the scan order for the coefficients inthe remaining second group of elements (shown in unshaded cells) may bedetermined as follows: Let r[j], j=0, . . . , N−1 denote the absolutevalue of the jth coefficient (from left to right) in the first row andlet c[i], i=0, . . . N−1, denote the absolute value of the ithcoefficient (from top to bottom) in the first column of an N×N currentblock, where N=4 in FIGS. 21A-B and, more generally, may be any integernumbers greater than or equal 2. Then, for the remaining coefficients inthe current block:

1. Compute cSum=c[L]+ . . . +c[N−1-K] and rSum=r[L]+ . . . +r[N−1-K],where L and K are a non-negative constants with L+K<N (e.g., in FIGS.21A-B, L=1 and K=1).

2. Then

-   -   a. if rSum>cSum and cSum==0, select the horizontal scan order;    -   b. If rSum>cSum and cSum>0, select the diagonal-left scan order        (e.g., downward to the left parallel to the anti-diagonal line);    -   c. if rSum<=cSum and rSum==0, select the vertical scan order;        otherwise    -   d. select the diagonal-right scan order (e.g., upward to the        right parallel to the anti-diagonal line).        Note that the scan order used for the first group can be any        default scan order (horizontal, diagonal, alternating diagonal,        zig-zag, vertical, etc.) that is known to both the encoder and        the decoder. Note further that for larger blocks like 8×8,        16×16, 32×32 or even bigger ones, L and/or K may be increased        correspondingly. For example, K may be N/2−1, i.e., K=3 when        N=8, K=7 when N=16, K=15 when N=32, etc. In some        implementations, the value of L and/or K may be sent as part of        header information, e.g. picture or coding block header, to the        decoder. Different values of L and/or K for the first column and        the first row may be used. In that case, cSum and rSum may be        scaled according to the number of positions used to accumulate        the respective sums. Note also that though a set of four        distinct scan orders (diagonal-left, horizontal, vertical,        diagonal-right} are used in this document to illustrate the        solution, these are merely examples. Other scan orders including        but not limited to zig-zag (downward first), zig-zag (right        first) may be used.

In some implementations, r[i] above indicates whether the i-thcoefficient in the first row is non-zero or not, and c[j] aboveindicates whether the j-th coefficient in the first column is non-zeroor not, where i, j=0, . . . , N−1. As such, rSum=r[L]+ . . . +r[N−1-K]indicates a count of non-zero coefficients in the first row betweenindices L and N−1-K inclusive, and cSum=c[L]+ . . . +c[N−1-K] indicatesa count of non-zero coefficients in the first column between indices Land N−1-K inclusive. Then

1. if rSum>cSum and cSum==0, select the horizontal scan order;

2. If rSum>cSum and cSum>0, select the diagonal-left scan order;

3. if rSum<=cSum and rSum==0, select the vertical scan order; otherwise

4. select the diagonal-right scan order.

In comparison to the example scheme of FIGS. 15A-B where the first rowand the first column were used to define the first group of elements ofthe block, the scheme of FIGS. 21A-B defines a smaller first group ofelements and thus has the potential to leverage a better scan order in alarger second group of elements to improve coding efficiency.

In some implementations, cSum and rSum may be computed by usingcoefficient values at positions beyond the first row and the firstcolumn. For example, let u[i,j] denote the absolute value or magnitudeof the coefficient at block position [i, j] (i-th row and j-th column).Then cSum and rSum may be computed as follows in Equation (13) below.Let K<2N be a non-negative constant that is known to the encoder and thedecoder.

$\begin{matrix}{{{cSum} = {\sum\limits_{m = 1}^{K}{\sum\limits_{i = {{ceil}{(\frac{m + 1}{2})}}}^{m}{u\left\lbrack {i,{m - i}} \right\rbrack}}}}{{rSum} = {\sum\limits_{m = 1}^{K}{\sum\limits_{i = {{ceil}{(\frac{m + 1}{2})}}}^{m}{u\left\lbrack {{m - j},j} \right\rbrack}}}}} & (13)\end{matrix}$

In Equation (13), cSum in effect is the sum of absolute values ofcoefficients that are located below the main diagonal line, and above oron an antidiagonal line defined by K, that is, coefficients at positions[i, j] where i+j<=K, and j<i. Correspondingly, in Equation (13), rSum isthe sum of absolute values of coefficients that are located above themain diagonal line, and above or on an antidiagonal line defined by K,that is, coefficients at positions [i, j] where i+j<=K, and i<j.

The size and shape of the first group of elements of a block may beselected based on the size of the block of image data to implement asize dependent partition of the block. In view of the fact that thenumber of boundary pixels in an N×N block of image data (e.g., transformcoefficients) grows linearly in the order O(N) with the dimension N andthe number of pixels in the block grows quadratically in the orderO(N²), and the fact that the first group of elements uses a fixed scanorder and the second group potentially benefits from a scan orderlearned from the first group, we see that coding efficiency might beimproved by making the partition of a block into two groups of elementsdependent upon the block size and possibly other information like atransform type (e.g., Discrete Cosine Transform, Discrete FourierTransform, identity, etc.).

To see this, let us examine the following table.

TABLE 2 Size of the first group of elements of a block relative to blocksize Size of the Size of the first group first group consisting ofconsisting of the the upper-left Percentage first row and the Percentagetriangle as in of the first column as of the N FIGS. 21A-B block size inFIGS. 15A-B block size 4 6 0.375 7 0.4375 8 15 0.234375 15 0.234375 1645 0.17578125 31 0.12109375 32 153 0.1494140625 63 0.0615234375 64 5610.1369628906 127 0.03100585938

In view of Table 2, we see that using the upper-left triangle to definethe first group of elements as described in relation to FIGS. 21A-Bproduces a smaller first group than using the first row and column as inrelation to FIGS. 15A-B when N=4, the two schemes are even when N=8, andthe scheme of 15A-B produces a smaller first group when N>8. As such, insome implementations the scheme of FIGS. 21A-B may be used for smallertransforms like 4×4 or 8×8 and the scheme of 15A-B or a combination ofthe scheme of 21A-B and the scheme of 15A-B may be used for largertransforms like 8×8 and above. As an example of combining the scheme of21A-B and the scheme of 15A-B, the first group may consist of a fixedsize of upper-left triangle plus an additional segment of the first rowand an additional segment of the first column. FIGS. 22A-B show twoexamples of combining the two algorithms for an 8×8 transform, where thesize of the first group of elements in FIG. 22A is 12 and the size ofthe first group of elements in FIG. 22B is 14, both are smaller than thefirst group of elements that would be used by the scheme of 21A-B or thescheme of 15A-B.

FIG. 22A is a diagram of an example of a scan order 2200 for a firstgroup of elements of a block of image data. In FIG. 22A, the elements ofthe first group appear in shaded cells and are labeled with are scanorder sequence numbers for respective elements of the block at thecorresponding locations within the block. The scan order 2200 includesan alternating diagonal scan order for the first group of elements ofthe block. The first group of elements for the scan order 2200 includeselements forming a triangle in a corner of the block, and wherein thetriangle includes elements of a first row of the block and elements of afirst column of the block (e.g., the elements labeled 0-5 in the scanorder 2200). The first group of elements for the scan order 2200 alsoincludes elements of a first row of the block that are outside of thetriangle and elements of a first column of the block that are outside ofthe triangle (e.g., the elements labeled 6-11 in the scan order 2200).For example, a second group of elements of the block may include allremaining elements of the block outside of the first group.

FIG. 22B is a diagram of an example of a scan order 2250 for a firstgroup of elements of a block of image data. In FIG. 22B, the elements ofthe first group appear in shaded cells and are labeled with are scanorder sequence numbers for respective elements of the block at thecorresponding locations within the block. The scan order 2250 includesan alternating diagonal scan order for the first group of elements ofthe block. The first group of elements for the scan order 2250 includeselements forming a triangle in a corner of the block, and wherein thetriangle includes elements of a first row of the block and elements of afirst column of the block (e.g., the elements labeled 0-9 in the scanorder 2250). The first group of elements for the scan order 2250 alsoincludes elements of a first row of the block that are outside of thetriangle and elements of a first column of the block that are outside ofthe triangle (e.g., the elements labeled 10-13 in the scan order 2200).For example, a second group of elements of the block may include allremaining elements of the block outside of the first group.

When adaptive scan order is used, the scan order for the second group ofelements is inferred from the elements (e.g., transform coefficients)decoded in the first group. Though the inferred scan order may work wellfor the second group in many cases, there might still be cases where theinferred scan order is not the best scan order among a given set ofavailable scan orders, i.e., another scan order might provide bettercompression performance (e.g., coding efficiency) for a given block ofimage data. To address this opportunity, some implementations may codeand send (e.g., in a bitstream) the scan order for the second group ofelements, and use the first group of elements to determine a scan orderpredictor and the context used in coding the this scan order for thesecond group.

To illustrate this predictive coding of the second scan order, considerthe following example. Suppose now that a block of transformcoefficients is partitioned into two groups as shown in FIGS. 21A-B. Lett∈{0, 1, 2, 3} denote a variable indicating the scan order for thesecond group determined based on elements of the first group (e.g.,using a scheme described in relation to FIGS. 21A-B), where

-   -   0 indicates the default diagonal-right scan order    -   1 indicates the horizontal scan order    -   2 indicates the vertical scan order    -   3 indicates the diagonal-left scan order.

Compute cSum=c[1]+ . . . +c[N−1-K] and rSum=r[1]+ . . . +r[N−1-K], whereK<N is a non-negative constant. Then determine t as follows:

-   -   if rSum>cSum and cSum==0, set t=1;    -   if rSum>cSum and cSum>0, set t=3;    -   if rSum<=cSum and rSum==0, set t=2;    -   otherwise, set t=0.        Next, encode or decode the selected scan order s∈{0, 1, 2, 3}        given t. In one example, encoding s given t is as follows:    -   Encode a binary flag ScanOrderNotEqualToPredictor indicating        whether s==t.    -   If ScanOrderNotEqualToPredictor is 0, encoding of s terminates;    -   otherwise encode s as a symbol in {0,1,2,3}\{t}, where for two        sets A and B,        A\B indicates the complement of B with respect to A.        Correspondingly, decoding s given t from a coded bitstream is as        follows:    -   Decode from the bitstream a binary flag        ScanOrderNotEqualToPredictor.    -   If ScanOrderNotEqualToPredictor is 0, set s=t and decoding of s        terminates;    -   otherwise decode s as a symbol in {0,1,2,3}\{t}.

In the above, encoding and decoding s as a symbol in {0,1,2,3}\{t} mayfurther use t to determine a context. In one example, t itself may beused as the context. In another example, f(t)=0 if t==0 or t==3 andf(t)=1 if t==1 or t==2 may be used as the context.

The predictive coding of the second scan order described above can beintegrated with the process 1600 of FIG. 16 and the process 1700 of FIG.17. For example, the process 1600 of FIG. 16 may be modified to includedetermining a scan order prediction based on the elements of the firstgroup; and encoding, using the entropy encoder, a scan order adjustmentparameter that is based on the second scan order and the scan orderprediction. This scan order adjustment parameter may be output as partof the bitstream. For example, the process 1700 of FIG. 17 may bemodified such that determining 1730, based on the elements of the firstgroup, the second scan order for the second group from the plurality ofgroups of elements includes determining a scan order prediction based onthe elements of the first group; decoding, using the entropy decoder,data from the encoded bitstream to obtain a scan order adjustmentparameter; and determining the second scan order based on the scan orderprediction and the scan order adjustment parameter.

Some implementations may provide for embedded signaling of whether scanorder adaptation is enabled. In some applications, flexibility to enableor disable scan order adaptation is advantageous. To implement a scanorder adaptation enablement feature, a signaling scheme may be used toinstruct the decoder to enable or disable scan order adaptation.Typically such a signaling scheme involves coding and sending a binaryflag to the decoder. For example, suppose that the flag is namedEnableScanOrderSelection. Then the scan order selection is enabled ifEnableScanOrderSelection is set (i.e. equal to 1) and the scan orderselection is disable if the flag is cleared (i.e. equal to 0).

Coding EnableScanOrderSelection adds additional bits to the codedbitstream and impacts compression performance. In some implementations,the processes described herein (e.g., the process 1600 of FIG. 16 andthe process 1700 of FIG. 17) may be modified to embed signalingindicating whether scan order adaptation (e.g., as described in relationto FIGS. 15A-B, FIGS. 21A-B, or combinations of these schemes) isenabled or not. For example, let absSum denote the sum of absolutevalues of all quantized coefficients (available to both the encoder andthe decoder) in the first group of elements of a block of image data.Then the parity of absSum may be used to signal whether scan orderadaptation is enabled for the second group of elements of the block. Inone example, if absSum is greater than or equal to a threshold (e.g.,2), and if absSum is even, then the scan order for the second group isdetermined as described in relation to FIGS. 21A-B; otherwise (i.e., ifabsSum is less than the threshold or if absSum is odd) the scan orderfor the second group is a default scan order (e.g., diagonal-right orzig-zag).

In the above examples, whether scan order adaptation is enabled ordisabled is inferred from the values of the first group of elements(e.g., transform coefficients), and does not require additional bits inthe coded bitstream. As such, such information may be regarded as beingembedded in the coefficients at the possible cost of increaseddistortion.

The embedded coding to enable adaptation of the second scan orderdescribed above can be integrated with the process 1600 of FIG. 16 andthe process 1700 of FIG. 17. For example, the process 1600 of FIG. 16may be modified to include determining a sum of magnitudes of all theelements of the first group; checking a parity of the sum; and adjustingan element of the first group to change the parity of the sum to signalthat use of the second scan order is enabled. For example, the process1700 of FIG. 17 may be modified to include determining a sum ofmagnitudes of all the elements of the first group; checking a parity ofthe sum; and enabling use of the second scan order based on the parityof the sum.

In some implementations, the parity of absSum may be used to signal thescan order directly. For example, if absSum is even, the scan order forthe second group is a default scan order (e.g., diagonal-right orzig-zag); and if absSum is odd, the scan order is an alternate scanorder (e.g. diagonal-left, horizontal, or vertical). In addition, toallow for flexibility to disable such a signaling scheme, scan orderinference based on absSum may be disabled if absSum is less than aprescribed a threshold and/or the number of nonzero coefficients in thefirst group of elements of a block of image data is less than athreshold.

To facilitate frequency band derivation in the presence of adaptive scanorders, where the same scan position may correspond to different blockpositions in different blocks, block positions (rather than scanpositions) may be used in band derivation operations.

Coding efficiency for a block of image data may be improved by adaptingcontext based on elements in a first group or subset of the block.Non-zero quantized transform (e.g., Discrete Cosine Transform)coefficients typically concentrate in the top left corner around the DCposition. However, the exact locations of these non-zero coefficientsare entropy coded and sent to the decoder. It may nevertheless bepossible to shed light on where these non-zero coefficients will likelyappear in a transform block if some values in the transformed block arealready decoded and known, and leverage such knowledge to improve codingefficiency. Drawing inspiration from the idea of two-stage scan foradapting scan order, a context model is designed to adapt based on asubset of decoded coefficients in the block (e.g., block of quantizedtransform coefficients). This adaptive context model design may arefinement of a current context model (e.g. an AV1 or VP9 context modelfor coefficient coding).

FIG. 23 is a flowchart of an example of a process 2300 for adaptingcontext to encode a block of video data. The process 2300 includespartitioning 2310 a block of video data into a plurality of groups ofelements; encoding 2320, using an entropy encoder, elements of a firstgroup from the plurality of groups of elements; selecting 2322 a nextgroup from the plurality of groups; determining 2330 a category based onthe elements of the prior group(s); based on the category, selecting2332 one or more contexts for elements from a next group from theplurality of groups of elements; encoding 2340, using the entropyencoder using the context(s), the elements of the next group from theplurality of groups of elements; and continuing (at 2345) to process anyremaining groups from the plurality of groups until all groups have beenencoded 2340 and then outputting 2350 the encoded elements of the blockto a bitstream. For example, the process 2300 may be implemented by theentropy encoder 712. For example, the process 2300 may be implemented bythe transmitting station 102. For example, the process 2300 may beimplemented by a computing device, such as the computing device 200. Forexample, the process 2300 may be implemented by a software programincluding machine-readable instructions that can be stored in a memorysuch as the memory 204 or the secondary storage 214, and that can beexecuted by a processor, such as CPU 202, to cause a computing device toperform the process 2300. For example, the process 2300 may beimplemented by an encoder such as the encoder 400 of FIG. 4. Forexample, the process 2300 may be implemented by the entropy encodingstage 408 of the encoder 400 of FIG. 4.

The process 2300 includes partitioning 2310 a block of video data into aplurality of groups of elements. The groups may be disjoint. The blockmay include a two-dimensional array of elements (e.g., a 4×4, 8×8,16×16, 32×32, or any other square or rectangular block size). A groupfrom the plurality of groups of elements may be continuous ordiscontinuous within the structure of the block. For example, theelements of the block may be pixel values (e.g., luminosity values). Forexample, the elements of the block may be quantized transformcoefficients. For example, the elements of the block may be quantizedtransform coefficients of a residual block (e.g., a residual blockresulting from intra-frame prediction or a residual block resulting frominter-frame prediction). For example, the elements of the block may bebased on a result of inter-frame prediction. For example, the block maybe a residual block resulting from inter-frame prediction. For example,the elements of the block may be based on a result of intra-frameprediction. For example, the block may be a residual block resultingfrom intra-frame prediction. In some implementations, the elements ofthe block each represent a sub-block of quantized transformcoefficients. In some implementations, the plurality of groups includestwo groups (e.g., as shown in the examples of FIGS. 15A-B, FIGS. 21A-B,FIG. 22A or FIG. 22B). For example, a first group may include elementsof a first row of the block and elements of a first column of the block.In some implementations, the first group includes elements forming atriangle in a corner of the block, and wherein the triangle includeselements of a first row of the block and elements of a first column ofthe block (e.g., as shown in the examples of FIGS. 21A-B, FIG. 22A orFIG. 22B). In some implementations, the first group includes elements ofa first row of the block that are outside of the triangle and elementsof a first column of the block that are outside of the triangle (e.g.,as shown in the examples of FIG. 22A or FIG. 22B). For example, a shapeof the first group may be selected based on a size of the block (e.g.,as described in relation to Table 2). For example, a second group mayinclude all remaining elements of the block outside of the first group.In some implementations, the plurality of groups includes more than twogroups of elements.

The process 2300 includes encoding 2320, using an entropy encoder,elements of a first group from the plurality of groups of elements. Forexample, the first group of elements may be encoded using a default orinitial scan order that a compatible entropy decoder is configured touse to decode elements of the first group for the block. For example,the first scan order may be a zig-zag order (e.g., as shown in FIG. 15A)or an alternating diagonal order (e.g., as shown in FIG. 21A). Forexample, the entropy encoder may employ entropy encoding techniques suchas, for example, variable length coding (VLC), context adaptive binaryarithmetic coding (CABAC), or context adaptive (multi-symbol) arithmeticcoding.

The process 2300 includes selecting 2322 a next group (e.g., a secondgroup) from the plurality of groups of elements of the block.

The process 2300 includes determining 2330 a category based on theelements of one or more prior groups (e.g., based on the elements of thefirst group). The category may be used to select 2332 a context forencoding one or more elements of a subsequent group (e.g., a secondgroup) of elements of the block. For example, the category maycorrespond a spatial distribution of element values of the block and/orto a scan order that may be used for one or more subsequent groups ofelements of the block. In some implementations, the category is one ofhorizontal, vertical, diagonal-left, and diagonal-right (e.g., asillustrated in FIG. 21A). For example, the category may be determined2330 based on a distribution of non-zero elements (e.g., quantizedtransform coefficients of a residual block) within the first group ofelements of the block. For example, the category order may be determined2330 based on a distribution of non-zero elements within a union ofprior groups). For example, the process 2500 of FIG. 25A may beimplemented to determine 2330 the category. For example, the process2550 of FIG. 25B may be implemented to determine 2330 the category. Insome implementations, the process 2300 includes determining, based onthe category, a scan order for the second group from the plurality ofgroups of elements. In some implementations, a process similar to theprocess 1800 of FIG. 18A may be used to determine 2430 the category. Forexample, determining 2430 the category may include determining a firstsum of magnitudes of elements in a portion of a first row of the block;determining a second sum of magnitudes of elements in a portion of afirst column of the block; and responsive to the first sum beingpositive and the second sum being zero, determine the category to be avalue corresponding to a horizontal scan order. In some implementations,a process similar to the process 1840 of FIG. 18B may be used todetermine 2430 the category. For example, determining 2430 the categorymay include determining a first count of non-zero elements in a portionof a first row of the block; determining a second count of non-zeroelements in a portion of a first column of the block; and responsive tothe first count being zero and the second count being positive,determine the category to be a value corresponding to a vertical scanorder.

For example, the category may be determined 2330 using the followingtechnique: Let u[i, j] denote a coefficient at block position (i, j) ina block (e.g., a transform block) of size N×N, where i=0, . . . , N−1and j=0, . . . , N−1. Suppose that the block is partitioned into twogroups of elements as in FIGS. 15A-B, FIGS. 21A-B, FIG. 22A or FIG. 22B.Then the category is determined 2330 by

-   -   1.) Compute cSum=c[L]+ . . . +c[N−1-K] and rSum=r[L]+ . . .        +r[N−1-K], where L<N and K<N are non-negative constants.    -   2.) Then derive a category t from {0, 1, 2, 3}.        -   if rSum>cSum and cSum==0, set t=1;        -   if rSum>cSum and cSum>0, set t=3;        -   if rSum<=cSum and rSum==0, set t=2;        -   otherwise, set t=0;            The category values may correspond to scan orders and may be            used to select both scan orders and contexts for elements of            the second group of elements of the block. For example, t=0            may correspond to a diagonal-right scan order, t=1 may            correspond to a horizontal scan order, t=2 may correspond to            a vertical scan order, and t=3 may correspond to a            diagonal-left scan order. In some implementations, the rSum            and cSum that are used to determine 2330 the category, may            be determined according to Equation (13) above. For example,            these sums may be sums of magnitudes of the respective            elements or counts of binary indicators of whether a            respective element has a non-zero value.

The process 2300 includes based on the category, selecting 2332 acontext for an element from a second group from the plurality of groupsof elements. In some implementations, all the elements in the secondgroup will be encoded with a single context that is selected 2332 basedon the category. In some implementations, individual elements in thesecond group have position dependent contexts for decoding that areselected 2332 based on the category. For example an entropy encoder maybe configured to use a context from a table of contexts (e.g., including18 or 72 contexts) shared with a matching decoder. An index to thistable used to select one of the contexts for decoding an element of theblock may be modified based on the category determined 2330 based onelements of the first group of elements. Suppose now that to encode u[i,j] or a syntax element like whether u[i,j]==0 that is derived fromu[i,j], a default context Ctx[i,j] is derived by using an existingcontext (e.g., a VP9 context model for coefficient coding). Then a newcontext is determined based on the default context for the element andthe category t that has been determined 2330 for the block. For example,the context may be selected 2332 according to: Ctx_new[i, j]=f(Ctx[i,j],i, j, t) where f is a mapping satisfying the constraint: f(x,i, j,t)≠f(x,i,j,t′) for at least one three-tuple (x, i, j), and a distinctpair (t, t′) where 0≤t<t′≤3. Examples of function f include f(x,i, j,t)=x*4+t and f(x,i,j,t)=t*W+x, where W is the number of distinct valuesthat Ctx[i,j] may take. Note that in the above, x might depend upon (i,j). In some implementations, to alleviate the so-called context dilutionproblem caused by having too many distinct contexts, the proposed designmay impose the following constraint on the function f. f(x,i, j,t=1)=f(x, j, i, t=2) and/or f(x,i, j, t=0)=f(x, j, i, t=3).

The process 2300 includes encoding 2340, using the entropy encoder usingthe context, the element of the next group (e.g., the second group) fromthe plurality of groups of elements. For example, the entropy encodermay employ entropy encoding techniques such as, for example, variablelength coding (VLC), context adaptive binary arithmetic coding (CABAC),or context adaptive (multi-symbol) arithmetic coding. In someimplementations, by adapting the context used for elements of the nextgroup, the coding efficiency of the entropy encoder may be improved.

In some implementations, encoding 2340 of elements of the next group(e.g., the second group) uses a scan order that has determined based onthe category. For example, the process 2300 may include encoding, usingthe entropy encoder using the scan order, elements of the second groupfrom the plurality of groups of elements. For example, the scan ordermay be a horizontal scan order, a vertical scan order, a diagonal-rightscan order, a diagonal-left scan order, a zig-zag scan order, etc.(e.g., as shown in FIG. 15A or FIG. 21A).

If (at 2345) the last group from the plurality of groups of elements ofthe block has not yet been encoded, then the next group is selected 2322and the processing of groups continues to encode remaining elements ofthe block.

When (at 2345) the last group from the plurality of groups of elementsof the block has been encoded, the encoded elements of the block areoutput 2350 to an encoded bitstream. For example, the encoded elementsmay be output from the entropy encoder 712 through the multiplexer 718to be included in the bitstream 720 that bears a video signal includingthe block. In some implementations, the bitstream may be stored (e.g.,in memory or on a disk) or transmitted (e.g., via network communicationlink). In some implementations (not shown), encoded elements may beoutput to an encoded bitstream as they become available.

FIG. 24 is a flowchart of an example of a process 2400 for adaptingcontext to decode a block of video data. The process 2400 includespartitioning 2410 a block of video data into a plurality of groups ofelements; decoding 2420, using an entropy decoder, data from an encodedbitstream to obtain elements of a first group from the plurality ofgroups of elements; selecting 2422 a next group from the plurality ofgroups; determining 2430 a category based on the elements of the priorgroup(s); based on the category, selecting 2432 one or more contexts forelements from the next group from the plurality of groups of elements;decoding 2440, using the entropy decoder using the context(s), data fromthe encoded bitstream to obtain the elements of the next group from theplurality of groups of elements; and continuing (at 2445) to process anyremaining groups from the plurality of groups until all groups have beendecoded 2440 and then outputting 2450 the decoded elements of the blockfor processing to generate video. For example, the process 2400 may beimplemented by the entropy decoder 756. For example, the process 2400may be implemented by the receiving station 106. For example, theprocess 2400 may be implemented by a computing device, such as thecomputing device 200. For example, the process 2400 may be implementedby a software program including machine-readable instructions that canbe stored in a memory such as the memory 204 or the secondary storage214, and that can be executed by a processor, such as CPU 202, to causea computing device to perform the process 2400. For example, the process2400 may be implemented by a decoder such as the decoder 500 of FIG. 5.For example, the process 2400 may be implemented by the entropy decodingstage 502 of the decoder 500 of FIG. 5.

The process 2400 includes partitioning 2410 a block of video data into aplurality of groups of elements. The groups may be disjoint. The blockmay include a two-dimensional array of elements (e.g., a 4×4, 8×8,16×16, 32×32, or any other square or rectangular block size). A groupfrom the plurality of groups of elements may be continuous ordiscontinuous within the structure of the block. For example, theelements of the block may be pixel values (e.g., luminosity values). Forexample, the elements of the block may be quantized transformcoefficients. For example, the elements of the block may be quantizedtransform coefficients of a residual block (e.g., a residual blockresulting from intra-frame prediction or a residual block resulting frominter-frame prediction). For example, the elements of the block may bebased on a result of inter-frame prediction. For example, the block maybe a residual block resulting from inter-frame prediction. For example,the elements of the block may be based on a result of intra-frameprediction. For example, the block may be a residual block resultingfrom intra-frame prediction. In some implementations, the elements ofthe block each represent a sub-block of quantized transformcoefficients. In some implementations, the plurality of groups includestwo groups (e.g., as shown in the examples of FIGS. 15A-B, FIGS. 21A-B,FIG. 22A or FIG. 22B). For example, a first group may include elementsof a first row of the block and elements of a first column of the block.In some implementations, the first group includes elements forming atriangle in a corner of the block, and wherein the triangle includeselements of a first row of the block and elements of a first column ofthe block (e.g., as shown in the examples of FIGS. 21A-B, FIG. 22A orFIG. 22B). In some implementations, the first group includes elements ofa first row of the block that are outside of the triangle and elementsof a first column of the block that are outside of the triangle (e.g.,as shown in the examples of FIG. 22A or FIG. 22B). For example, a shapeof the first group may be selected based on a size of the block (e.g.,as described in relation to Table 2). For example, a second group mayinclude all remaining elements of the block outside of the first group.In some implementations, the plurality of groups includes more than twogroups of elements.

The process 2400 includes decoding 2420, using an entropy decoder, datafrom an encoded bitstream to obtain elements of a first group from theplurality of groups of elements. For example, the first group ofelements may be decoded using a default or initial scan order that acompatible entropy encoder is configured to use to encode elements ofthe first group for the block. For example, the first scan order may bea zig-zag order (e.g., as shown in FIG. 15A) or an alternating diagonalorder (e.g., as shown in FIG. 21A). For example, the entropy decoder mayemploy entropy decoding techniques such as, for example, variable lengthcoding (VLC), context adaptive binary arithmetic coding (CABAC), orcontext adaptive (multi-symbol) arithmetic coding.

The process 2400 includes selecting 2422 a next group (e.g., a secondgroup) from the plurality of groups of elements of the block.

The process 2400 includes determine 2430 a category based on theelements of one or more prior groups (e.g., based on the elements of thefirst group). The category may be used to select 2432 a context fordecoding one or more elements of a subsequent group (e.g., a secondgroup) of elements of the block. For example, the category maycorrespond a spatial distribution of element values of the block and/orto a scan order that may be used for one or more subsequent groups ofelements of the block. In some implementations, the category is one ofhorizontal, vertical, diagonal-left, and diagonal-right (e.g., asillustrated in FIG. 21A). For example, the category may be determined2430 based on a distribution of non-zero elements (e.g., quantizedtransform coefficients of a residual block) within the first group ofelements of the block. For example, the category order may be determined2430 based on a distribution of non-zero elements within a union ofprior groups). For example, the process 2500 of FIG. 25A may beimplemented to determine 2430 the category. For example, the process2550 of FIG. 25B may be implemented to determine 2430 the category. Insome implementations, the process 2400 includes determining, based onthe category, a scan order for the second group from the plurality ofgroups of elements. In some implementations, a process similar to theprocess 1800 of FIG. 18A may be used to determine 2430 the category. Forexample, determining 2430 the category may include determining a firstsum of magnitudes of elements in a portion of a first row of the block;determining a second sum of magnitudes of elements in a portion of afirst column of the block; and responsive to the first sum beingpositive and the second sum being zero, determine the category to be avalue corresponding to a horizontal scan order. In some implementations,a process similar to the process 1840 of FIG. 18B may be used todetermine 2430 the category. For example, determining 2430 the categorymay include determining a first count of non-zero elements in a portionof a first row of the block; determining a second count of non-zeroelements in a portion of a first column of the block; and responsive tothe first count being zero and the second count being positive,determine the category to be a value corresponding to a vertical scanorder.

For example, the category may be determined 2430 using the followingtechnique: Let u[i, j] denote a coefficient at block position (i, j) ina block (e.g., a transform block) of size N×N, where i=0, . . . , N−1and j=0, . . . , N−1. Suppose that the block is partitioned into twogroups of elements as in FIGS. 15A-B, FIGS. 21A-B, FIG. 22A or FIG. 22B.Then the category may be determined 2430 by

-   -   3.) Compute cSum=c[L]+ . . . +c[N−1-K] and rSum=r[L]+ . . .        +r[N−1-K], where L<N and K<N are non-negative constants.    -   4.) Then derive a category t from {0, 1, 2, 3}.        -   if rSum>cSum and cSum==0, set t=1;        -   if rSum>cSum and cSum>0, set t=3;        -   if rSum<=cSum and rSum==0, set t=2;        -   otherwise, set t=0;            The category values may correspond to scan orders and may be            used to select both scan orders and contexts for elements of            the second group of elements of the block. For example, t=0            may correspond to a diagonal-right scan order, t=1 may            correspond to a horizontal scan order, t=2 may correspond to            a vertical scan order, and t=3 may correspond to a            diagonal-left scan order. In some implementations, the rSum            and cSum that are used to determine 2430 the category, may            be determined according to Equation (13) above. For example,            these sums may be sums of magnitudes of the respective            elements or counts binary indicators of whether a respective            element has a non-zero value.

The process 2400 includes based on the category, selecting 2432 acontext for an element from a second group from the plurality of groupsof elements. In some implementations, all the elements in the secondgroup will be decoded with a single context that is selected 2432 basedon the category. In some implementations, individual elements in thesecond group have position dependent contexts for decoding that areselected 2432 based on the category. For example an entropy decoder maybe configured to use a context from a table of contexts (e.g., including18 or 72 contexts) shared with a matching encoder. An index to thistable used to select one of the contexts for decoding an element of theblock may be modified based on the category determined 2430 based onelements of the first group of elements. Suppose now that to decode u[i,j] or a syntax element like whether u[i,j]==0 that is derived fromu[i,j], a default context Ctx[i,j] is derived by using an existingcontext (e.g., a VP9 context model for coefficient coding). Then a newcontext is determined based on the default context for the element andthe category t that has been determined 2430 for the block. For example,the context may be selected 2432 according to: Ctx_new[i, j]=f(Ctx[i,j],i, j, t) where f is a mapping satisfying the constraint: f(x,i, j,t)≠f(x,i,j,t′) for at least one three-tuple (x, i, j), and a distinctpair (t, t′) where 0≤t<t′≤3. Examples of function f include f(x,i, j,t)=x*4+t and f(x,i,j,t)=t*W+x, where W is the number of distinct valuesthat Ctx[i,j] may take. Note that in the above, x might depend upon (i,j). In some implementations, to alleviate the so-called context dilutionproblem caused by having too many distinct contexts, the proposed designmay impose the following constraint on the function f. f(x,i, j,t=1)=f(x, j, i, t=2) and/or f(x,i, j, t=0)=f(x, j, i, t=3).

The process 2400 includes decoding 2440, using the entropy decoder usingthe context, data from the encoded bitstream to obtain the element ofthe next group (e.g., the second group) from the plurality of groups ofelements. For example, the entropy decoder may employ entropy decodingtechniques such as, for example, variable length coding (VLC), contextadaptive binary arithmetic coding (CABAC), or context adaptive(multi-symbol) arithmetic coding. In some implementations, by adaptingthe context used for elements of the next group, the coding efficiencyof the entropy decoder may be improved.

In some implementations, decoding 2440 of elements of the next group(e.g., the second group) uses a scan order that has determined based onthe category. For example, the process 2400 may include decoding, usingthe entropy decoder, data from the encoded bitstream to obtain, using ascan order, elements of the second group from the plurality of groups ofelements. For example, the scan order may be a horizontal scan order, avertical scan order, a diagonal-right scan order, a diagonal-left scanorder, a zig-zag scan order, etc. (e.g., as shown in FIG. 15A or FIG.21A).

If (at 2445) the last group from the plurality of groups of elements ofthe block has not yet been decoded, then the next group is selected 2422and the processing of groups continues to decode remaining elements ofthe block.

When (at 2445) the last group from the plurality of groups of elementsof the block has been decoded, the decoded elements of the block areoutput 2450 for processing to generate video. For example, the decodedelements may be output 2450 from the entropy decoder 756 through theinverse quantization/transform 760 and used to generate thereconstructed block 764 that forms part of a video. In someimplementations, the resulting video may be stored (e.g., in the memory204 or the secondary storage 214), transmitted (e.g., via a networkcommunication link), or displayed (e.g., in a user interface, such as onscreen or a projection). For example, the process 2400 may includedisplaying video that is generated based in part on decoded elements ofthe block (e.g., where the elements of the block are quantized transformcoefficients of a residual block).

FIG. 25A is a flowchart of an example of a process 2500 for determininga category for a block based on a subset of elements of the block ofimage data. The process 2500 includes determining 2510 a first sum ofmagnitudes of elements in a portion of the first group below a maindiagonal of the block and at or above an anti-diagonal of the block;determining 2512 a second sum of magnitudes of elements in a portion ofthe first group above the main diagonal of the block and at or above theanti-diagonal of the block; and determining 2520 the category based onthe first sum and the second sum. The same process 2500 may be used fordetermining a category in both an encoder and a compatible decoder. Forexample, the process 2500 may be implemented by the entropy encoder 712or the entropy decoder 756. For example, the process 2500 may beimplemented by the transmitting station 102 or the receiving station106. For example, the process 2500 may be implemented by a computingdevice, such as the computing device 200. For example, the process 2500may be implemented by a software program including machine-readableinstructions that can be stored in a memory such as the memory 204 orthe secondary storage 214, and that can be executed by a processor, suchas CPU 202, to cause a computing device to perform the process 2500. Forexample, the process 2500 may be implemented by a decoder such as thedecoder 500 of FIG. 5. For example, the process 2500 may be implementedby an encoder such as the encoder 400 of FIG. 4. For example, theprocess 2500 may be implemented by the entropy encoding stage 408 of theencoder 400 of FIG. 4. For example, the process 2500 may be implementedby the entropy decoding stage 502 of the decoder 500 of FIG. 5.

For example, a first sum of magnitudes of elements in a portion of thefirst group below a main diagonal of the block and at or above ananti-diagonal of the block may be determined 2510 as cSum according toEquation (13). For example, a second sum of magnitudes of elements in aportion of the first group above the main diagonal of the block and ator above the anti-diagonal of the block may be determined 2512 as rSumaccording to Equation (13).

The process 2500 includes determining 2520 the category based on thefirst sum and the second sum. For example, the category may bedetermined by comparing the first sum and the second sum to each otherand/or to zero. For example, the category t may be determined 2570according to:

-   -   if Sum_2>Sum_1 and Sum_1==0, set t=1;    -   if Sum_2>Sum_1 and Sum_1>0, set t=3;    -   if Sum_2<=Sum_1 and Sum_2==0, set t=2;    -   otherwise, set t=0;

FIG. 25B is a flowchart of an example of a process 2550 for determininga category for a block based on a subset of elements of the block ofimage data. The process 2550 includes determining 2560 a first count ofnon-zero elements in a portion of the first group below a main diagonalof the block and at or above an anti-diagonal of the block; determining2562 a second count of non-zero elements in a portion of the first groupabove the main diagonal of the block and at or above the anti-diagonalof the block; and determining 2570 the category based on the first countand the second count. The same process 2500 may be used for determininga category in both an encoder and a compatible decoder. For example, theprocess 2500 may be implemented by the entropy encoder 712 or theentropy decoder 756. For example, the process 2500 may be implemented bythe transmitting station 102 or the receiving station 106. For example,the process 2500 may be implemented by a computing device, such as thecomputing device 200. For example, the process 2500 may be implementedby a software program including machine-readable instructions that canbe stored in a memory such as the memory 204 or the secondary storage214, and that can be executed by a processor, such as CPU 202, to causea computing device to perform the process 2500. For example, the process2500 may be implemented by a decoder such as the decoder 500 of FIG. 5.For example, the process 2500 may be implemented by an encoder such asthe encoder 400 of FIG. 4. For example, the process 2500 may beimplemented by the entropy encoding stage 408 of the encoder 400 of FIG.4. For example, the process 2500 may be implemented by the entropydecoding stage 502 of the decoder 500 of FIG. 5.

For example, a first count of non-zero elements in a portion of thefirst group below a main diagonal of the block and at or above ananti-diagonal of the block may be determined 2560 as cSum according toEquation (13). For example, a second count of non-zero elements in aportion of the first group above the main diagonal of the block and ator above the anti-diagonal of the block may be determined 2562 as rSumaccording to Equation (13).

The process 2550 includes determining 2570 the category based on thefirst count and the second count. For example, the category may bedetermined by comparing the first count and the second count to eachother and/or to zero. For example, the category t may be determined 2570according to:

-   -   if Count_2>Count_1 and Count_1==0, set t=1;    -   if Count_2>Count_1 and Count_1>0, set t=3;    -   if Count_2<=Count_1 and Count_2==0, set t=2;    -   otherwise, set t=0;

The aspects of encoding and decoding described above illustrate someencoding and decoding techniques. However, it is to be understood thatencoding and decoding, as those terms are used in the claims, could meancompression, decompression, transformation, or any other processing orchange of data.

The words “example” or “implementation” are used herein to mean servingas an example, instance, or illustration. Any aspect or design describedherein as “example” or “implementation” is not necessarily to beconstrued as preferred or advantageous over other aspects or designs.Rather, use of the words “example” or “implementation” is intended topresent concepts in a concrete fashion. As used in this application, theterm “or” is intended to mean an inclusive “or” rather than an exclusive“or”. That is, unless specified otherwise, or clear from context, “Xincludes A or B” is intended to mean any of the natural inclusivepermutations. That is, if X includes A; X includes B; or X includes bothA and B, then “X includes A or B” is satisfied under any of theforegoing instances. In addition, the articles “a” and “an” as used inthis application and the appended claims should generally be construedto mean “one or more” unless specified otherwise or clear from contextto be directed to a singular form. Moreover, use of the term “animplementation” or “one implementation” throughout is not intended tomean the same embodiment or implementation unless described as such.

Implementations of transmitting station 102 and/or receiving station 106(and the algorithms, methods, instructions, etc., stored thereon and/orexecuted thereby, including by encoder 400 and decoder 500) can berealized in hardware, software, or any combination thereof. The hardwarecan include, for example, computers, intellectual property (IP) cores,application-specific integrated circuits (ASICs), programmable logicarrays, optical processors, programmable logic controllers, microcode,microcontrollers, servers, microprocessors, digital signal processors orany other suitable circuit. In the claims, the term “processor” shouldbe understood as encompassing any of the foregoing hardware, eithersingly or in combination. The terms “signal” and “data” are usedinterchangeably. Further, portions of transmitting station 102 andreceiving station 106 do not necessarily have to be implemented in thesame manner.

Further, in one aspect, for example, transmitting station 102 orreceiving station 106 can be implemented using a computer or processorwith a computer program that, when executed, carries out any of therespective methods, algorithms and/or instructions described herein. Inaddition, or alternatively, for example, a special purposecomputer/processor can be utilized which can contain other hardware forcarrying out any of the methods, algorithms, or instructions describedherein.

Transmitting station 102 and receiving station 106 can, for example, beimplemented on computers in a video conferencing system. Alternatively,transmitting station 102 can be implemented on a server and receivingstation 106 can be implemented on a device separate from the server,such as a hand-held communications device. In this instance,transmitting station 102 can encode content using an encoder 400 into anencoded video signal and transmit the encoded video signal to thecommunications device. In turn, the communications device can thendecode the encoded video signal using a decoder 500. Alternatively, thecommunications device can decode content stored locally on thecommunications device, for example, content that was not transmitted bytransmitting station 102. Other transmitting station 102 and receivingstation 106 implementation schemes are available. For example, receivingstation 106 can be a generally stationary personal computer rather thana portable communications device and/or a device including an encoder400 may also include a decoder 500.

Further, all or a portion of implementations of the present disclosurecan take the form of a computer program product accessible from, forexample, a tangible computer-usable or computer-readable medium. Acomputer-usable or computer-readable medium can be any device that can,for example, tangibly contain, store, communicate, or transport theprogram for use by or in connection with any processor. The medium canbe, for example, an electronic, magnetic, optical, electromagnetic, or asemiconductor device. Other suitable mediums are also available.

The above-described embodiments, implementations and aspects have beendescribed in order to allow easy understanding of the present disclosureand do not limit the present disclosure. On the contrary, the disclosureis intended to cover various modifications and equivalent arrangementsincluded within the scope of the appended claims, which scope is to beaccorded the broadest interpretation so as to encompass all suchmodifications and equivalent structure as is permitted under the law.

What is claimed is:
 1. A system for decoding video, comprising: amemory; and a processor, wherein the memory stores instructionsexecutable by the processor to cause the system to: partition a block ofvideo data into a plurality of groups of elements; decode, using anentropy decoder, data from an encoded bitstream to obtain, using a firstscan order, elements of a first group from the plurality of groups ofelements, wherein the first group includes elements forming a trianglein a corner of the block, and wherein the triangle includes elements ofa first row of the block and elements of a first column of the block;determine, based on the elements of the first group, a second scan orderfor a second group from the plurality of groups of elements; and decode,using the entropy decoder, data from the encoded bitstream to obtain,using the second scan order, elements of the second group from theplurality of groups of elements.
 2. The system of claim 1, wherein theelements of the block are quantized transform coefficients.
 3. Thesystem of claim 1, wherein the first group includes elements of a firstrow of the block that are outside of the triangle and elements of afirst column of the block that are outside of the triangle.
 4. Thesystem of claim 1, wherein a shape of the first group is selected basedon a size of the block.
 5. The system of claim 1, wherein the memorystores instructions executable by the processor to cause the system to:determine a sum of magnitudes of all the elements of the first group;check a parity of the sum; and enable use of the second scan order basedon the parity of the sum.
 6. The system of claim 1, wherein theinstructions for determining, based on the elements of the first group,the second scan order for the second group from the plurality of groupsof elements include instructions executable by the processor to causethe system to: determine a scan order prediction based on the elementsof the first group; decode, using the entropy decoder, data from theencoded bitstream to obtain a scan order adjustment parameter; anddetermine the second scan order based on the scan order prediction andthe scan order adjustment parameter.
 7. The system of claim 1, whereinthe instructions for determining, based on the elements of the firstgroup, the second scan order for the second group from the plurality ofgroups of elements include instructions executable by the processor tocause the system to: determine a first count of non-zero elements in aportion of the first group below a main diagonal of the block and at orabove an anti-diagonal of the block; determine a second count ofnon-zero elements in a portion of the first group above the maindiagonal of the block and at or above the anti-diagonal of the block;and determine the second scan order based on the first count and thesecond count.
 8. The system of claim 1, wherein the instructions fordetermining, based on the elements of the first group, the second scanorder for the second group from the plurality of groups of elementsinclude instructions executable by the processor to cause the system to:determine a first sum of magnitudes of elements in a portion of thefirst group below a main diagonal of the block and at or above ananti-diagonal of the block; determine a second sum of magnitudes ofelements in a portion of the first group above the main diagonal of theblock and at or above the anti-diagonal of the block; and determine thesecond scan order based on the first sum and the second sum.
 9. A methodfor decoding video comprising: partitioning a block of video data into aplurality of groups of elements; decoding, using an entropy decoder,data from an encoded bitstream to obtain, using a first scan order,elements of a first group from the plurality of groups of elements,wherein the first group includes elements forming a triangle in a cornerof the block, and wherein the triangle includes elements of a first rowof the block and elements of a first column of the block; determining,based on the elements of the first group, a second scan order for asecond group from the plurality of groups of elements; and decoding,using the entropy decoder, data from the encoded bitstream to obtain,using the second scan order, elements of the second group from theplurality of groups of elements.
 10. The method of claim 9, wherein theelements of the block are quantized transform coefficients.
 11. Themethod of claim 9, wherein the first group includes elements of a firstrow of the block that are outside of the triangle and elements of afirst column of the block that are outside of the triangle.
 12. Themethod of claim 9, comprising: determining a sum of magnitudes of allthe elements of the first group; checking a parity of the sum; andenabling use of the second scan order based on the parity of the sum.13. The method of claim 9, wherein determining, based on the elements ofthe first group, the second scan order for the second group from theplurality of groups of elements comprises: determining a scan orderprediction based on the elements of the first group; decoding, using theentropy decoder, data from the encoded bitstream to obtain a scan orderadjustment parameter; and determining the second scan order based on thescan order prediction and the scan order adjustment parameter.
 14. Themethod of claim 9, wherein determining, based on the elements of thefirst group, the second scan order for the second group from theplurality of groups of elements comprises: determining a first count ofnon-zero elements in a portion of the first group below a main diagonalof the block and at or above an anti-diagonal of the block; determininga second count of non-zero elements in a portion of the first groupabove the main diagonal of the block and at or above the anti-diagonalof the block; and determining the second scan order based on the firstcount and the second count.
 15. The method of claim 9, whereindetermining, based on the elements of the first group, the second scanorder for the second group from the plurality of groups of elementscomprises: determining a first sum of magnitudes of elements in aportion of the first group below a main diagonal of the block and at orabove an anti-diagonal of the block; determining a second sum ofmagnitudes of elements in a portion of the first group above the maindiagonal of the block and at or above the anti-diagonal of the block;and determining the second scan order based on the first sum and thesecond sum.
 16. A system for encoding video, comprising: a memory; and aprocessor, wherein the memory stores instructions executable by theprocessor to cause the system to: partition a block of video data into aplurality of groups of elements; encode, using an entropy encoder usinga first scan order, elements of a first group from the plurality ofgroups of elements, wherein the first group includes elements forming atriangle in a corner of the block, and wherein the triangle includeselements of a first row of the block and elements of a first column ofthe block; determine, based on the elements of the first group, a secondscan order for a second group from the plurality of groups of elements;and encode, using the entropy encoder using the second scan order,elements of the second group from the plurality of groups of elements.17. The system of claim 16, wherein the first group includes elements ofa first row of the block that are outside of the triangle and elementsof a first column of the block that are outside of the triangle.
 18. Thesystem of claim 16, wherein the memory stores instructions executable bythe processor to cause the system to: determine a sum of magnitudes ofall the elements of the first group; check a parity of the sum; andadjust an element of the first group to change the parity of the sum tosignal that use of the second scan order is enabled.
 19. The system ofclaim 16, wherein the memory stores instructions executable by theprocessor to cause the system to: determine a scan order predictionbased on the elements of the first group; and encode, using the entropyencoder, a scan order adjustment parameter that is based on the secondscan order and the scan order prediction.
 20. The system of claim 16,wherein the instructions for determining, based on the elements of thefirst group, the second scan order for the second group from theplurality of groups of elements include instructions executable by theprocessor to cause the system to: determine a first count of non-zeroelements in a portion of the first group below a main diagonal of theblock and at or above an anti-diagonal of the block; determine a secondcount of non-zero elements in a portion of the first group above themain diagonal of the block and at or above the anti-diagonal of theblock; and determine the second scan order based on the first count andthe second count.